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Executive  Summary 


This  is  the  second  volume  of  a  two-volume  report.  The  first  volume  defined  the  concepts  of 
advanced  engineering  environments  (AEEs),  the  benefits  they  could  provide  to  small  manu¬ 
facturing  enterprises  (SMEs),  technical  considerations  in  their  adoption  by  SMEs,  and  typical 
commercial-off-the-shelf  (COTS)  elements  comprising  AEEs  [Fenves  03]. 

To  assist  the  SME  in  adopting  AEEs,  two  self-assessment  tools  are  provided  in  this  volume. 
Additionally,  this  volume  provides  guidance  on  migration  paths  to  higher  AEE  capabilities, 
AEE  component  selection,  and  technology  adoption  strategies. 

The  first  tool,  the  Self-Assessment  Tool  for  Engineering  Environments  (SAT-EE)  assists  an 
SME  in  assessing  the  adequacy  of  their  current  computing  support  environment  in  handling 
technical  tasks  (i.e.,  Computer-Aided  Design  [CAD]  /  Computer-Aided  Engineering  [CAE]  / 
Computer  Aided  Manufacturing  [CAM]).  This  information  can  then  be  used  to  support  deci¬ 
sion  making  with  respect  to  expanding  or  upgrading  the  environment  along  the  migration 
paths  presented  in  this  report. 

The  second  tool  is  the  Self-Assessment  Tool  for  Engineering  Tool  Capabilities  (SAT-ETC). 
Through  this  tool,  the  SME  can  collect  the  needs  and  desires  of  the  company,  and  map  them 
to  the  capabilities  of  specific  classes  of  CAD  and  CAE  tools,  showing  the  utility  of  these 
tools  to  the  SME’s  needs. 

Many  SMEs  evolve  or  migrate  from  lower  AEE  levels  to  higher  ones.  As  new  tools  and  ca¬ 
pabilities  are  introduced  into  a  company’s  support  environment  on  an  incremental  and  oppor¬ 
tunistic  basis,  the  SME  must  recognize  that  shifts  in  operational  modes  and  philosophies  will 
be  needed  to  gain  the  full  benefit  of  the  AEE. 

In  choosing  a  tool  to  be  added  to  the  SME’s  engineering  environment,  the  SME  must  con¬ 
sider  both  current  and  expected  future  needs,  taking  into  account  potential  changes  in  busi¬ 
ness  and  software.  The  SME  must  consider  more  than  just  the  functional  capabilities  of  the 
tool,  addressing  issues  including 

•  interoperability  in  support  the  organization’s  overall  product  development  process; 

•  usability  by  its  potential  users;  and 
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•  expandability,  in  terms  of  tool  features  that  may  be  subsequently  added,  and  customiza¬ 
tion  that  users  may  apply. 

Selection,  procurement,  and  installation  of  a  new  technology  will  not  produce  the  desired 
benefits  unless  the  SME’s  staff  adopts  the  technology  and  integrates  it  into  the  SME’s  opera¬ 
tion.  Only  when  the  staff  is  aware  of  the  technology,  has  access  to  it,  is  trained  to  use  it,  gets 
support  for  using  it,  and  actually  uses  it,  will  the  benefits  accrue  to  the  SME. 

A  six-step  technology  adoption  process  based  upon  the  Shewart  Cycle,  an  early  model  devel¬ 
oped  for  process  improvement,  is  presented  [Shewart  39].  The  process  has  been  used  success¬ 
fully  to  introduce  advanced  technologies  into  SMEs  and  consists  of  the  following  steps: 

1 .  Understand  existing  company  environment; 

2.  Establish  technology  adoption  project  goals  &  metrics; 

3.  Evaluate  technology  options; 

4.  Obtain  technology; 

5.  Implement  and  adopt  technology;  and 

6.  Analyze  and  deliver  adoption  results. 
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Abstract 


To  assist  the  Small  Manufacturing  Enterprise  (SME)  in  adopting  Advanced  Engineering  En¬ 
vironments  (AEEs),  this  report  provides  two  self-assessment  tools.  The  Self-Assessment  Tool 
for  Engineering  Environments  (SAT-EE)  assists  an  SME  in  assessing  the  adequacy  of  the  cur¬ 
rent  computing  support  environment  in  handling  technical  tasks.  The  Self-Assessment  Tool 
for  Engineering  Tool  Capabilities  (SAT-ETC)  enables  the  SME  to  collect  data  on  the  needs  of 
the  company,  and  maps  it  to  specific  classes  of  AEE  tools.  An  SME  may  migrate  to  higher 
AEE  levels  through  an  orderly  sequence  of  steps.  Migration  success  is  enhanced  by  careful 
attention  to  AEE  component  selection  and  by  application  of  a  defined  technology  adoption 
process. 


CMU/SEI-2004-TR-007 


IX 


X 


CM  U/SE I-2004-TR-007 


1  Introduction 


1.1  Context  of  Report 

This  report  is  the  second  in  a  series  of  two  addressing  Advanced  Engineering  Environments 
(AEEs)  and  their  application  to  Small  Manufacturing  Enterprises  (SMEs). 


1.2  Purpose 

The  purpose  of  this  two-volume  report  is  to  build  awareness  of  the  AEE  concept,  and  assist 

SMEs  in  evaluating  the  desirability  and  feasibility  of  incorporating  an  AEE  into  their  busi¬ 
ness  operations. 

Volume  I  of  this  report  presented  the  following  [Fenves  03]: 

•  candidate  architectures  for  AEEs  and  comments  on  their  applicability  to  SMEs; 

•  the  benefits  that  may  accrue  to  an  SME  from  the  adoption  of  an  AEE  in  terms  of  internal 
and  external  effects; 

•  technical  considerations  that  enter  in  the  decision  to  adopt  or  upgrade  an  AEE; 

•  issues  that  an  SME  must  consider  when  incorporating  an  AEE  into  its  operation;  and 

•  the  general  characteristics  and  capabilities  of  architectural  elements  or  components  for 
AEEs  targeted  upon  geometry-centric  design  efforts. 

The  purpose  of  Volume  II  is 

•  to  assist  the  SME  in  assessing  its  current  status  and  future  needs  with  respect  to  AEEs; 

•  to  outline  a  series  of  migration  steps  whereby  an  SME  may  incrementally  augment  and 
expand  its  software  environment  supporting  the  organization’s  design  activities; 

•  to  define  a  method  for  selecting  and  adopting  the  Commercial  Off-the-Shelf  (COTS) 
tools  that  comprise  an  AEE;  and 

•  to  define  a  process  to  aid  the  SME  in  adopting  a  new  technology. 
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2  Self-Assessment  of  AEE  Requirements 


This  section  presents  two  tools  that  may  be  used  by  an  SME  to  assess  its  current  status  and 
future  needs  with  respect  to  AEEs  and  their  component  COTS  elements: 

1.  Self-Assessment  Tool  for  Engineering  Environments  (SAT-EE) — this  tool  assists  an 
SME  in  evaluating  the  adequacy  of  computing  support  for  its  current  design  operations; 
and 

2.  Self-Assessment  Tool  for  Engineering  Tool  Capabilities  (SAT-ETC) — this  tool  assists  an 
SME  in  understanding  the  value  of  various  classes  of  engineering  tools  to  its  current  and 
future  design  operations. 

The  function,  use,  and  results  of  each  of  these  tools  are  discussed  in  this  chapter. 


2.1  Self-Assessment  Tool  for  Engineering  Environ¬ 
ments 

2.1.1  Introduction 

As  discussed  in  Volume  I,  Chapter  2  of  this  report  series  an  AEE  may  be  categorized  at  one 
of  three  levels  [Fenves  03]: 

1.  Basic  AEE; 

2.  Intermediate  AEE;  and 

3 .  Comprehensive  AEE. 

This  section  provides  a  tool  whereby  an  SME  can  assess  the  adequacy  of  its  computing  sup¬ 
port  environment  in  handling  its  technical  tasks  (i.e.,  Computer-Aided  Design  [CAD]  /  Com¬ 
puter-Aided  Engineering  [CAE]  /  Computer-Aided  Manufacturing  [CAM]).  The  SME  can 
then  make  decisions  with  respect  to  expanding  or  upgrading  the  environment  along  the  mi¬ 
gration  paths  presented  in  Chapter  3. 

The  initial  concept  for  this  section  was  a  form  of  a  predictive  or  normative  tool  that  could 
make  deductions  of  the  form  “If  your  company  designs/produces  X,  then  it  should  be  running 
engineering  support  environment  Y.”  On  reflection,  it  became  clear  that  dozens  of  aspects  of 
the  company’s  business  would  have  to  be  considered  to  define  “X”  with  sufficient  precision 
and  detail  to  be  able  to  determine  the  various  aspects  of  “Y.”  (These  aspects  are  discussed  in 
Volume  I  with  some  specificity.)  Furthermore,  limited  trials  showed  that  even  the  nature  of 
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the  aspects  to  consider  is  not  clear.  For  example,  one  would  expect  that  the  nature  of  the 
product  being  manufactured  may  have  some  bearing  on  the  outcome,  but  how  would  one 
characterize  the  differences  in  the  required  computational  support  between,  say,  a  foundry,  a 
welding  shop,  and  a  metal  stamping  plant?  It  was  finally  concluded  that  we  don’t  have  the 
knowledge  and  range  of  expertise  to  produce  a  credible  predictive  tool. 

Attention  thus  turned  to  a  less  ambitious,  but  more  achievable  descriptive  tool  that  could  be 
used  to  provide  a  rapid,  albeit  very  coarse,  assessment  of  the  company’s  current  practices 
with  respect  to  the  environment  supporting  design  and  engineering,  and  of  the  adequacy  of 
the  currently  available  engineering  environment.  The  remainder  of  this  section  deals  with  the 
resulting  self-assessment  tool. 

See  the  Software  Engineering  Institute  (SEI)  Web  site 

( http://www.sei.cmu.edu/tide/publications/SAT-EE.XLS  )  for  an  interactive  version  of  this 
tool.  An  excerpt  from  the  tool  is  seen  in  Figure  1 . 
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RESULTS 

COMPOSITE  SCORE  2.0 

APPROXIMATE  LEVEL  OF  ENVIRONMENT  intermediate  level 
IMPROVEMENT  OPPORTUNITIES  none  identified 

73 

r  8 

■  Category  =  -=  w 

3  3  O 

=:  w  -i 

W  CD  CDB 

CAD  2.2 


| CAD  tool  type _ _  5.0 


Do  you  use  a  CAD  tool? 

y/n 

Y 

Desktop  CAD 

y/n 

y 

Light- duty  CAD 

y/n 

y 

Heavy-duty  CAD 

y/n 

y 

| CAD  add-ons 

1.0 

Purchased  or  rented  symbol  and/or  detail  libraries 

y/n 

n 

Purchased  or  rented  discipline-specific  add-ons 

y/n 

n 

Internally  developed  libraries  and/or  add-ons 

y/n 

y 

1  |CAD  usage 

3.6 

%  of  designers  that  have  CAD  seats 

% 

80 

%  of  design  information  received  from  suppliers  as  CAD  files 

% 

20 

%  of  design  information  sent  to  customers  as  CAD  files 

% 

30 

%  of  design  information  sent  to  manufacturing  as  CAD  files 

% 

10 

%  of  design  information  stored  as  CAD  files 
reused  on  new  projects 

% 

30 

CAE 

1.7 

|  |CAE  tool  type 

2.5 

Do  you  use  a  CAE  tool?  (as  opposed  to  spreadsheets, 
standalone  programs,  analysis  consultants,  etc.) 

y/n 

y 

Light- duty  CAE 

y/n 

y 

Heavy-duty  CAE 

y/n 

y 

Does  the  CAE  tool  include  special  features  for  particular  kinds 
of  applications  (e.  g.,  sheet  metal  forming,  non-linear  analysis, 
etc.)? 

y/n 

y 

Does  the  CAE  tool  support  multiple  analysis  disciplines 
(e.g.  stress,  thermal,  electromagnetic,  etc.)? 

y/n 

n 

| CAE  usage 

3.3 

%  of  engineers  that  have  CAE  seats 

% 

20 

%  of  designers  that  have  training  in  and  use  CAE 

% 

0 

%  of  analyses  performed  by  outside  consultants 

% 

20 

%  of  design  information  shared  with  suppliers  and  customers 
in  the  form  of  CAE  models  and  results  (  as  opposed  to 
information  shared  in  the  form  of  CAD  models,  drawinqs,  etc.) 

% 

30 

Is  CAE  used  in  proposals  and/or  preliminary  design? 

y/n 

y 

Is  CAE  used  in  detailed  design? 

y/n 

y 

What  is  the  average  number  of  design  iterations  based  on 
feedback  from  CAE  analyses? 

number 

3 

Figure  1:  Excerpt  from  the  SAT-EE 
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2.1.2  Function  of  the  SAT-EE 


The  SAT-EE  collects  information  about  the  engineering  environment  at  the  SME  in  nine 
categories: 

1.  CAD  (Computer-Aided  Design) 

2.  CAE  (Computer-Aided  Engineering) 

3.  CAM  (Computer-Aided  Manufacturing) 

4.  CAD/CAE  integration1 

5.  CAD/CAM  integration 

6.  PDM  (Product  Data  Management) 

7.  CAD/PDM  integration 

8.  Catalog  access 

9.  Database  support 

In  each  category,  information  is  collected  within  two  sub-categories: 

a.  the  type  of  tool  used  in  that  category;  and 

b.  some  characteristic  statistics  about  the  extent  of  the  tool’s  usage.  In  the  case  of 
CAD,  there  is  a  third  sub-category  of  information  collected  about  the  add-ons  to  the 
COTS  CAD  systems. 

Based  on  the  information  entered,  the  SAT-EE  assigns  the  following: 

•  a  composite  numerical  score,  in  the  range  of  0  to  5,  for  each  of  the  nine  categories; 

•  a  weighted  aggregate  score,  again  in  the  range  of  0  to  5,  for  the  environment  as  a  whole; 

•  an  approximate  determination  of  the  level  of  the  environment  (below  minimum,  mini¬ 
mum,  intermediate,  above  intermediate);  and 

•  some  recommended  changes  in  the  environment. 

Keep  in  mind  that  the  SAT-EE  is  very  empirical  and  approximate  in  nature,  since  the  infor¬ 
mation  collected  is  by  no  means  exhaustive.  Furthermore,  the  weights,  weighting  functions, 
and  composite  aggregation  functions  were  determined  based  upon  the  experience  of  the  au¬ 
thors  with  a  limited  number  of  SMEs.  While  the  authors  believe  that  this  tool  is  applicable  to 
a  wide  range  of  SMEs,  users  of  the  tool  are  cautioned  to  carefully  consider  the  applicability 
of  the  tool  to  their  organization,  and  exercise  good  judgment  in  interpreting  the  results.  Nev¬ 
ertheless,  the  tool  is  presented  as  a  first  attempt  towards  solving  the  problem  of  environment 
assessment.  A  future  usability  study  may  be  used  to  evaluate  its  effectiveness  and  refine  its 
categories,  questions  within  the  categories,  weights,  and  weighing  functions. 


1  Readers  of  Volume  I  in  this  series  will  recognize  that  the  tool  is  geared  towards  the  Basic  AEE 
summarized  in  Section  2.1.1  of  that  volume:  it  is  assumed  that  the  CAD  system,  rather  than  the  da¬ 
tabase  system,  acts  as  the  central  repository  of  product  information  [Fenves  03]. 
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2.1.3  Use  of  the  SAT-EE 


Steps  for  using  the  SAT-EE  are  described  below. 

1.  Activate  the  SAT-EE  as  an  Excel  spreadsheet.  The  tool  is  compatible  with  Microsoft® 
Excel  2002.  Select  the  “Assessment  Tool”  worksheet  of  the  tool. 

2.  All  areas  requiring  user  input  are  color-coded  in  bright  yellow.  Initially,  all  the  re¬ 
sponses  (column  F)  are  blank  and  all  sub-category  and  category  scores  display  the  “er¬ 
ror”  message. 

3.  Enter  a  response  to  every  question  within  reason.  (If  you  answered  “no”  to  the  question 
“Do  you  use  a  CAE  tool?”  you  need  not  answer  the  remaining  questions  in  the  sub¬ 
category  pertaining  to  the  CAE  tool.  However,  in  other  categories  there  may  be  multiple 
responses;  a  company  may  be  using  desktop,  light  and  heavy-duty  CAD  systems  simul¬ 
taneously.) 

4.  Fields  marked  “y/n”  in  the  “Units”  column  (color  coded  in  pale  yellow)  respond  only  to 
a  “y”  or  an  “n”;  those  marked  “%”  respond  to  an  integer  between  0  and  100;  those 
marked  “number”  respond  to  an  integer  value. 

5.  When  responses  for  a  category  are  completed,  the  composite  scores  for  the  category  and 
its  sub-categories  are  displayed.  When  all  categories  are  completed,  the  aggregate  score, 
the  approximate  level  of  the  environment,  and  the  recommended  changes  in  the  envi¬ 
ronment  are  displayed. 

6.  You  may  experiment  with  alternate  scenarios  by  clearing  some  or  all  of  the  responses 
and  entering  new  values: 

a.  To  clear  all  responses:  click  on  the  pull-down  menu  of  the  Excel  Name  Box  (located 
near  the  upper  left  comer  of  the  spreadsheet  on  the  left  side  of  the  Formula  Bar)\ 
click  on  “AllResponses”;  and  press  “Delete.” 

b.  To  clear  values  in  a  particular  category:  click  on  the  pull-down  menu  of  the  Name 
Box ;  click  on  the  name  of  the  appropriate  response  category  (e.g.,  “PDMRe- 
sposes”);  and  press  “Delete.” 


®  Microsoft  and  Excel  2002  are  registered  trademarks  of  Microsoft  Corp.,  Redmond,  WA. 
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2.1.4  Interpretation  of  Results 

The  Composite  Score  (cell  H6)  is  calculated  as  the  weighted  average  of  nine  category  scores, 
weighted  is  as  follows: 


Category  Weight 

CAD  2 

CAE  1 

CAM  1 

PDM  1 

CAD/CAE  Integration  1 

CAD/CAM  Integration  1 

CAD/PDM  Integration  1 

Catalog  Access  1 

Database  1 


Examination  of  each  of  these  category  scores  will  reveal  areas  for  potential  improvement  that 
could  enhance  the  AEE  level  of  the  organization.  The  user  may  experiment  with  these  areas  to 
assess  the  impact  of  proposed  changes.  The  SME  must  evaluate  these  potential  improvement 
areas  in  the  context  of  its  business  strategy  to  achieve  meaningful  operational  improvement. 


The  Composite  Score  (cell  H6)  presented  by  the  tool  is  a  numerical  approximation  of  the  cur¬ 
rent  AEE  level  of  the  respondent.  AEE  levels  are  derived  from  this  score  as  follows: 


Composite  Score 

less  than  0.9 
0.9  to  1.7 
1.8  to  3.3 
3.4  and  above 


AEE  level 

below  Basic  AEE  level 
Basic  AEE  level 
Intermediate  AEE  level 
Comprehensive  AEE  level 


2.2  Self-Assessment  Tool  for  Engineering  Tool 
Capabilities 

2.2.1  Introduction 

This  section  describes  a  tool  whereby  an  SME  can  assess  its  needs  for  computational  tools 
for  technical  (CAD/CAE)  tasks  and  identify  the  additional  needed  tools  according  to  the  ap¬ 
propriate  criteria.  (These  criteria  will  be  discussed  in  detail  in  Chapter  4.) 


The  initial  concept  for  this  section  was  for  a  multi-level  tool  that  would 

1.  Identify  SME  needs  that  could  be  addressed  with  an  AEE  or  one  of  its  components; 
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2.  Identify  SME  problems  that  could  be  addressed  with  an  AEE; 

3.  Map  SME  problems  and  needs  to  generic  AEE  functions;  and 

4.  Map  generic  AEE  functions  to  classes  of  tools  comprising  AEEs. 

The  first  two  steps  turned  out  to  produce  extremely  long  lists  of  hypothetical  needs  and  prob¬ 
lems  without  much  structure.  As  soon  as  some  structuring  was  attempted,  it  became  clear  the 
next  two  steps  would  have  to  be  collapsed:  AEEs  have  very  little  functional  redundancy,  and 
a  need  can  be  addressed  or  a  problem  solved  by  only  one  software  component  of  the  AEE. 
The  capabilities  of  the  AEE  component  tools  provide  the  organizing  principle  for  the  needs 
and  problems. 

Thus,  the  needs  assessment  tool  became  less  ambitious,  but  more  practical  as  a  descriptive 
tool  which  could  be  used  to  provide  a  rapid,  albeit  very  coarse,  assessment  of  the  company’s 
needs — and  desires  for — problem-solving  capabilities  contained  in  AEE  component  tools. 
The  remainder  of  this  section  deals  with  the  resulting  self-assessment  tool. 


See  the  SEI  Web  site  (  http://www.sei.cmu.edu/tide/publications/SAT-ETC.XLS  )  for  an  in¬ 
teractive  version  of  this  tool.  An  excerpt  from  the  tool  is  seen  in  Figure  2. 
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1“ 

©  2003  try  Carnegie  Mellon  University 

SELF-ASSESSMENT  TOOL  FOR  ENGINEERING  TOOL  CAPABILITIES  (SAT-ETC)  vl.01 

Current  value 
Potential  value 

2.10 

2.83 

Category 

Response 

Score 

i - 1 - 1 — 

_ 

Very  valuable; 

in  routine  use  today 

Valuable; 

in  occasional  use  today 

Marginally  valuable; 

available  but 

we  have  no  training 

Potentially  very  valuable; 

would  use  immediately  if 

we  had  access  to  capability 

Potentially  valuable; 

would  consider  using  if 

we  had  access  to  capability 

Not  valuable  or 

unable  to  comment 

Current  value 

Potential  value 

MECHANICAL  CAD 

2.16 

3.52 

|3D  Component  Design 

1.7  2.1 

A1 

A2 

A3 

A A 

A5 

AJ6 

A7 

Create  3D  models  of  mechanical  and  structural  components 

y 

Define  and  use  "parametric”  3D  component  models  constructed  such 
that  a  change  in  a  dimensional  "parameter"  results  in  a  change  of  the 
design  and  appearance  of  the  component  (i.e.  changing  the  dimension  of 
a  hole  diameter  automatically  resizes  the  hole  shown  in  the  design) 

y 

Define  and  use  constraints  on  3D  component  models  (e.g.  specify  that 
two  surfaces  are  parallel,  specify  that  two  cylinders  are  concentric,  etc.) 

y 

Compose  component  models  using  saved  features,  catalog  entries,  and 
other  components 

y 

Assign/display  component  dimensions  and  tolerances 

y 

Assign/display  component  annotations  such  as  dimensions,  tolerances, 
explanatory  notes  Bill-of-materials  reference  numbers,  etc. 

y 

Assign/display  non-geometric  attributes  of  components  such  as  material 
properties,  surface  finishes,  etc. 

y 

1 

1 3D  Assembly  Design 

0.2  6.7| 

B1 

B2 

Generate  3D  sub-assemblies  and  assemblies  by  merging 
component  models 

y 

Define  interfaces  between  components  parametrically.  For  example,  two 
flanges  may  be  connected  by  a  circle  of"N"  bolts.  The  value  ofN 
defines  the  number  and  spacing  of  the  holes  in  both  components,  as 
well  as  the  number  of  bolts  on  the  BOM. 

y 

Figure  2:  Excerpt  from  SAT- ETC 

2.2.2  Function  of  the  SAT-ETC 

The  SAT-ETC  collects  information  about  engineering  problem-solving  needs  in  the  following 
categories  and  sub-categories: 

1 .  Mechanical  CAD 

a.  3D  Component  Design 

b.  3D  Assembly  Design 

c.  3D  Model  Reuse 

d.  3D  Model  Post-Processing  -  Graphical 

e.  3D  Model  Post-Processing  -  Non-Graphical 


2.  CAE-Finite  Element  Analysis 


a. 
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b. 


analysis  model  generation  and  import 
analysis  model  idealization  and  discretization 
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c.  analysis  model  reuse 

d.  analysis  options 

e.  analysis  purpose 

f.  structural  analysis  options 

g.  computational  fluid  mechanics  analysis  options 

h.  electrostatic/electromagnetic  analysis  options 

i.  thermal  analysis  options 

j.  multiphysics  analysis  options 

k.  post-processing  of  analysis  results 

3.  CAD-CAE  Integration 

a.  importing  from  CAD  to  CAE 

b.  idealization  of  CAD  model  into  CAE  model 

c.  post-processing  of  CAE  model 

d.  exporting  from  CAE  to  CAD 

In  each  sub-category,  a  number  of  problem-solving  capabilities  are  listed  and  the  user  is 
asked  to  rate  both  the  value  and  the  extent  of  use  as  either 

•  very  valuable  -  in  routine  use  today; 

•  valuable  -  in  occasional  use  today; 

•  marginally  valuable  -  available  but  we  have  no  training; 

•  potentially  very  valuable  -  would  use  immediately  if  we  had  access  to  capability; 

•  potentially  valuable  -  would  consider  using  if  we  had  access  to  capability;  or 

•  not  valuable  or  unable  to  comment. 

Based  on  the  information  entered,  the  tool  assigns  a  Current  Value  and  a  Potential  Value,  on  a 
scale  of  10.0  to  0.0,  to  each  sub-category,  then  to  each  of  the  three  main  categories,  and  fi¬ 
nally  to  the  response  as  a  whole. 

2.2.3  Use  of  the  SAT-ETC 

Steps  for  using  the  SAT-ETC  are  described  below. 

1.  Activate  the  SAT-ETC  as  an  Excel  spreadsheet.  The  tool  is  compatible  with  Microsoft® 
Excel  2002.  Select  the  “Assessment  Tool”  sheet  of  the  Workbook 

2.  Initially,  all  the  responses  (columns  C  through  H)  are  blank  and  all  sub-category  and 
category  scores  display  the  “error”  message. 
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3.  Enter  your  responses.  Enter  only  one  “y”  in  each  row.  A  character  other  than  “y”  does 
not  contribute  to  the  score. 

4.  When  responses  for  a  category  are  completed,  the  composite  scores  for  current  and  po¬ 
tential  values  of  the  category  are  displayed. 

5.  When  all  categories  are  completed,  the  aggregate  scores  are  displayed. 

6.  You  may  experiment  with  alternate  scenarios  by  clearing  some  or  all  of  the  responses 
and  entering  new  responses: 

a.  To  clear  all  responses:  click  on  the  pull-down  menu  next  to  the  Name  Box  (leftmost 
box  in  bottom  row  of  Excel  banner;  this  normally  displays  the  designation  of  the 
currently  active  cell);  click  on  “All  Responses”;  and  click  on  “Delete.” 

b.  To  clear  responses  in  a  particular  category:  click  on  the  pull-down  menu  next  to  the 
Name  Box ;  click  on  the  name  of  the  appropriate  response  category  (e.g.,  “CAD  Re¬ 
sponses”);  and  click  on  “Delete.” 

2.2.4  Interpretation  of  Results 

Based  on  the  information  entered,  the  tool  assigns  a  Current  Value  and  a  Potential  Value,  on  a 
scale  of  10.0  to  0.0,  to  each  sub-category,  then  to  each  of  the  three  main  categories,  and  fi¬ 
nally  to  the  response  as  a  whole.  Although  the  aggregated  scores  are  not  as  meaningful  as  in 
the  self-assessment  tool  presented  in  the  previous  section,  the  user  is  advised  to  scan  the  sub¬ 
categories  for  high  Potential  Value  scores — these  are  the  tools  and  tool  capabilities  that 
should  influence  the  tool  selection  process  described  in  Chapter  4  of  this  report. 


Keep  in  mind  that  the  SAT-ETC  is  empirical  and  approximate  in  nature,  due  to  the  fact  that 
the  information  collected  is  by  no  means  exhaustive,  nor  is  the  set  of  sub-categories  for  each 
main  category.  Furthermore,  the  set  of  main  categories  was  purposely  restricted  to  three  (i.e., 
mechanical  CAD,  CAE  using  FEA,  and  the  integration  of  the  two)  in  order  to  make  the  needs 
self-assessment  tool  manageable  in  size.  Finally,  for  simplicity,  the  authors  have  chosen  to 
treat  each  sub-category  independently  of  the  others,  when  in  reality  many  of  the  sub¬ 
categories  are  coupled  (e.g.,  the  Analysis  Purpose  and  the  Analysis  Options  sub-categories 
may  be  strongly  coupled  with  the  domain-specific  sub-categories  as  well  as  the  Integration 
sub-categories).  While  the  authors  believe  that  this  tool  is  applicable  to  a  wide  range  of 
SMEs,  users  of  the  tool  are  cautioned  to  carefully  consider  the  applicability  of  the  tool  to 
their  organizations,  and  exercise  good  judgment  in  interpreting  the  results.  Nevertheless,  the 
tool  is  presented  as  a  first  step  towards  an  assessment  solution.  A  future  usability  study  may 
be  conducted  to  evaluate  its  effectiveness  and  refine  its  categories,  sub-categories,  problem¬ 
solving  capabilities,  rating  scale  and  rating  aggregation. 
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3  Migration 


The  purpose  of  this  chapter  is  to  outline  a  series  of  migration  steps  whereby  an  SME  can  in¬ 
crementally  augment  and  expand  both  its  software  environment  supporting  design  activities, 
as  well  as  linkages  between  that  environment  and  other  corporate  activities.  The  transforma¬ 
tion  of  an  SME’s  design  capabilities  from  a  manual  drafting  state  to  an  AEE  is  segmented 
into  five  distinct  steps  as  listed  below  and  shown  in  Figure  3. 


FROM 

1.  Scratch  (i.e.,  manual) 

2.  CAD  for  drafting 

3.  CAD  and  external  analyses 

4.  Basic  AEE 

5 .  Intermediate  AEE 


TO 

CAD  for  drafting 
CAD  and  external  analyses 
Basic  AEE 
Intermediate  AEE 
Beyond 


Figure  3:  AEE  Migration 
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Each  of  the  steps  described  requires  considerable  learning,  experience  building,  and  confi¬ 
dence  building  on  the  part  of  all  the  participants  before  the  organization  is  ready  to  take  the 
next  step.  To  ensure  complete  adoption  of  the  current  level  and  readiness  to  advance,  it  is 
recommended  that  the  SME  execute  at  least  two  full  product  development  cycles  prior  to  ini¬ 
tiating  efforts  to  migrate  to  the  next  level.  Although  the  steps  are  described  in  this  report  as 
discrete  ones,  many  organizations  expand  their  computing  environments  incrementally,  as 
new  needs  or  corporate  functions  arise  and  as  new  capabilities  offered  by  software  vendors 
become  technically  and  economically  justifiable.  Nevertheless,  the  environments  defined  by 
the  steps  outlined  in  this  report  represent  fundamentally  different  modes  of  operation  and  phi¬ 
losophical  outlooks  on  computer-aided  product  development.  The  environments  resulting 
from  the  steps  described  in  detail  below  are  considered  to  be  prototypical  of  the  development 
of  engineering  drafting  environments  over  the  past  two  decades. 

Each  step  is  described  by  means  of  a  standard  template,  consisting  of  the  following  compo¬ 
nents: 

•  Synopsis  of  Situation :  a  brief  description  of  the  characteristic  features  of  the  organiza¬ 
tion’s  current  computing  environment; 

•  Symptoms',  signals,  both  internal  and  external,  that  indicate  that  the  current  situation  is 
becoming  difficult  or  uneconomical  to  maintain  and  that  a  transformation  to  a  higher 
level  is  warranted; 

•  Alternatives',  aspects  of  the  transformation  that  must  be  considered,  and  a  partial  list  of 
the  alternatives  available  for  selection  in  each  aspect; 

•  Decisions/evaluations',  the  criteria  to  be  used  for  each  selection  and  the  technical  consid¬ 
erations  that  may  enter  into  the  ranking  or  selection  of  the  alternatives; 

•  Training  needs  and  other  preparations',  the  technical,  organizational  and  personnel  issues 
to  be  addressed  in  preparation  for  the  migration;  and 

•  Results  to  be  expected',  a  brief  description  of  the  changes  that  may  realistically  be  ex¬ 
pected  to  occur  after  the  new  environment  is  put  in  place. 

3.1  From  Scratch  to  CAD  for  Drafting 

SYNOPSIS  OF  SITUATION'.  Manual  drafting  (i.e.,  pen,  paper,  and  drafting  boards)  is  rare 
today,  but  may  exist  in  some  small  manufacturing  enterprises.  Recent  surveys  show  that  75% 
of  SMEs  use  some  form  of  CAD  in  their  design  process  [SPIRC  01].  For  the  remaining  25%, 
computers  may  be  used  in  accounting,  parts  inventories,  etc.,  and  partial  CAD  modeling  may 
be  practiced  for  Numerically  Controlled  (NC)  machining  purposes.  However,  no  CAD  tools 
are  used  for  design;  all  design  documentation  consists  of  paper-based  drawings.  Engineering 
design  functions  may  use  spreadsheets  or  some  stand-alone  tools  as  organizational  or  analyti¬ 
cal  aids. 
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SYMPTOMS: 


•  Maintenance  of  paper  drawings  is  cumbersome. 

•  It  is  hard  to  search  drawings  for  design  reuse. 

•  Complete  redrawing  is  necessary  even  for  the  most  minute  design  modification. 

•  Lack  of  analyses  necessitates  repeated  physical  prototype  construction  and  testing. 

•  Paper-based  communication  is  inefficient,  both  vertically  (e.g.,  with  clients,  the  manufac¬ 
turing  division,  suppliers)  and  horizontally  among  design  and  engineering  groups. 

ALTERNATIVES:  Clearly,  the  prime  issue  to  consider  is  the  installation  of  a  CAD  system. 

The  options  to  be  explored  are  below: 

•  CAD  system  level  -  Alternatives  for  the  level  of  the  CAD  system  range  over 

-  Entry  level,  sometimes  referred  to  as  a  desktop  system; 

-  “Light”  version  of  one  of  the  major  CAD  systems;  or 

-  Full  strength  version. 

•  CAD  system  customization  -  Alternatives  for  the  degree  of  customization  needed  for 
the  CAD  system  are  as  follows: 

-  No  customization,  use  the  CAD  system  “out  of  the  box”,  adapting  design  methods  to 
suit  the  CAD  system; 

-  Purchase  or  rent  symbol  and/or  detail  libraries  from  CAD  vendors  or  third  parties; 

-  Purchase  or  rent  discipline-specific  add-ons  (e.g.,  sheet  metal  drafting)  from  the  same 
sources;  or 

-  Contract  out  for  the  development  of  custom  libraries. 

•  CAD/CAM  integration  -  Alternate  degrees  of  integration  may  be  pursued.  Some  op¬ 
tions  are  as  follows: 

-  Install  the  same  tool  or  platform  for  CAD  and  CAM,  with  different  add-ons; 

-  Plan  on  using  different  tools  for  CAD  and  CAM  and  interfacing  (exchanging  models 
between)  them  (e.g.,  via  the  Standard  for  the  Exchange  of  Product  Model  Data 
[STEP]);  or 

-  Initially  provide  no  interfacing. 

•  Personnel  allocation  -  This  may  be  an  even  harder  choice  than  software/platform  selec¬ 
tion.  The  extreme  points  of  alternatives  are  as  follows: 

-  No  segregation  of  duties:  all  designers  will  operate  the  CAD  system;  or 

-  Separation  of  functions  between  designers  and  CAD  station  operators. 


DECISIONS/EVALUATIONS:  The  above  options  must  be  explored  in  terms  of  the  considera¬ 
tions  below: 

•  Choice  of  CAD  level  -  The  choice  of  CAD  level  (i.e.,  entry,  light,  or  full-strength)  influ¬ 
ences  both  the  procurement  costs  and  the  operator  training  requirements.  Entry-level  sys- 
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terns  provide  the  least  demanding  transition  from  paper-based  design,  in  both  system  cost 
and  training,  but  their  performance  can  easily  degrade  when  working  on  larger  CAD  files 
typical  of  commercial  products.  Mid-range  versions,  while  somewhat  more  demanding  in 
training,  are  intended  to  offer  a  smooth  transition  to  the  next  level,  should  that  be  war¬ 
ranted. 

•  Choice  of  customization  level  -  The  degree  of  customization  chosen  for  a  COTS  CAD 
system  also  influences  cost;  however,  it  may  also  significantly  increase  the  efficiency, 
productivity,  and  satisfaction  of  the  users.  Purchase,  rental  or  acquisition  as  freeware  of 
symbol  and  detail  libraries,  and  generally  of  add-ons,  provides  big  dividends  in  produc¬ 
tivity  at  small  incremental  cost.  Large  amounts  of  customization  are  to  be  avoided.  At 
this  stage  of  low  in-house  familiarity  with  the  tools,  the  organization  must  take  care  to 
avoid  becoming  overly  dependent  on  the  provider  of  the  customized  software. 

•  Choice  of  integration  strategy  -  Whether  the  products  designed  by  the  SME  are  manu¬ 
factured  within  the  organization  or  by  outside  suppliers,  CAD/CAM  integration  should 
be  adopted  from  the  outset.  Unless  there  is  some  legacy  software  that  warrants  interfac¬ 
ing  between  CAD  and  CAM  tools,  it  makes  sense  to  adopt  the  same  platform  from  the 
start. 

•  Personnel  allocation  choices  -  Allocation  of  personnel  should  reflect  the  enterprise’s 
policies  and  working  conditions.  In  an  informal,  task-  or  project-oriented  design  depart¬ 
ment,  it  makes  sense  to  have  all  designers  access  the  CAD  system  directly,  whereas  in  a 
more  hierarchically  structured  workplace  specialized  CAD  station  operators,  who  are 
trained  to  be  experts  in  using  the  tools,  would  make  more  sense. 

TRAINING  NEEDS  AND  OTHER  PREPARATIONS:  The  most  important  preparation  has  to 
do  with  personnel:  selection  of  the  personnel  allocation  method;  training  and/or  hiring  of  per¬ 
sonnel;  and  planning  and  training  for  the  specialized  functions  that  will  arise  (e.g.,  CAD  sys¬ 
tem  manager,  CAD  system  maintainer,  CAD  file  archivist,  etc.).  The  introduction  of  a  new 
mode  of  doing  business  warrants,  even  mandates,  a  thorough  review  of  the  organization’s 
processes,  and  if  necessary,  a  reorganization.  Finally,  a  plan  must  be  developed  and  main¬ 
tained  for  the  upgrading  and  expansion  of  the  engineering  environment  and  the  orderly  re¬ 
placement  of  its  components  [Place  01]. 


RESULTS  TO  BE  EXPECTED:  After  some  initial  training  and  a  learning  curve,  the  organiza¬ 
tion  will  find  that  it  takes  less  time  to  generate  even  initial  drawings.  Search  for  and  modifi¬ 
cation  of  drawings  will  be  drastically  improved.  Electronic  storage  of  drawings  will  prove  to 
be  convenient  and  will  rapidly  lead  to  increased  design  reuse.  Generation  of  derived  informa¬ 
tion,  such  as  assembly  drawings  and  BOM,  will  be  easier  and  much  more  error-proof.  Even¬ 
tually,  the  advantages  of  a  smooth  transition  to  downstream  processes,  especially  with  3D 
models  (CAE,  CAM),  will  become  obvious.  Communication  with  other  designers,  engineers, 
and  clients  by  means  of  CAD  data  will  be  easier.2 


2  Anderson,  W.  Enabling  E-Commerce — Creating  an  Electronic  Environment.  Pittsburgh, 
PA:  Software  Engineering  Institute,  Carnegie  Mellon  University.  To  be  published. 
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3.2  From  CAD  for  Drafting  to  CAD  and  External 
Analyses 

SYNOPSIS  OF  SITUATION:  Two-dimensional  (2D)  and/or  three-dimensional  (3D)  CAD 
tools  are  used  for  drafting  and  for  representation  and  communication  of  the  product’s  geome¬ 
try  only.  In  all  other  respects,  conventional  or  “traditional”  engineering  practice  prevails,  ex¬ 
cept  for  the  substitution  of  CAD  tools  for  drafting  boards. 

SYMPTOMS'.  Rough  analyses  are  carried  out  using  design  manuals,  tables,  formulas  and  pos¬ 
sibly  spreadsheets  and  stand-alone  programs.  Whatever  analysis  model  exists  is  manually 
built  by  the  engineers,  with  extensive  dependence  on  the  engineers’  expert  knowledge. 
Analysis  is  even  harder  for  innovative  designs  or  new  design  configurations  about  which 
there  is  less  expertise.  The  products  tend  to  be  over-designed  due  to  the  engineers’  lack  of 
confidence  in  predicting  the  product’s  performance,  potentially  increasing  product  cost.  De¬ 
signs  are  verified  with  costly  physical  prototypes.  There  is  slow  response  to  customers’  Re¬ 
quests  for  Quotation  (RFQs)  that  have  substantial  technical  specifications.  Design  reuse  is 
not  easy  due  to  the  separate  management  of  design  and  analysis  data. 

ALTERNATIVES:  The  prime  issue  here  is  the  improvement  of  CAE  analysis  capability  com¬ 
mensurate  with  the  improved  geometry  manipulation  capability  afforded  by  a  CAD  system. 
The  two  major  alternatives  are  to  engage  an  external  consultant  or  to  jump  a  step  in  the  pro¬ 
gression  discussed  in  this  report  and  initiate  in-house  analysis  competence.  The  remainder  of 
the  discussion  addresses  the  first  alternative;  the  second  one  will  be  presented  in  the  discus¬ 
sion  of  the  succeeding  step.  The  major  issues  in  selecting  an  external  consultant  are  as  fol¬ 
lows: 

1 .  Consultancy  provider  type 

-  national  firm; 

-  local  firm  or  branch; 

-  small  firm  or  individual;  or 

-  application  Service  Provider  (ASP). 

2.  Timing  of  analyses  in  the  design  cycle 

-  early,  e.g.,  in  preliminary  design  or  even  in  response  to  a  RFQ; 

-  late,  typically  after  detailed  design  is  complete;  or 

-  at  several  stages  of  the  design  process. 

3.  Scope  of  consultant  functions 

-  “turnkey”  operation;  the  consultant  models,  idealizes,  analyzes,  interprets  analy¬ 
sis  results,  and  recommends  design  changes  as  needed; 

-  consultant  is  given  a  CAD  model  produced  by  the  SME.  The  consultant  ideal¬ 
izes  and  analyzes  the  model,  interprets  the  results,  and  reports  to  the  SME;  or 


CMU/SEI-2004-TR-007 


17 


the  SME  performs  modeling  and  idealization.  The  consultant  performs  the 
analysis.  The  SME  interprets  the  analysis  results  and  executes  design  changes  as 
needed. 


4.  If  multiple  functional  domains  are  involved  (e.g.,  structural,  thermal,  fluid  flow,  etc.), 
does  the  organization  engage 

-  one  analyst  who  functions  in  all  domains;  or 

-  several  analysts,  one  for  each  domain? 

5.  Disposition  of  existing  in-house  analysis  software 

-  continue  its  use; 

-  cancel  further  use;  or 

-  develop  in-house  software  for  checks  on  consultant’s  results. 


DECISIONS/EVALUATIONS:  The  issues  above  must  be  explored  with  regard  to  the  following 

factors: 

•  in-house  vs.  external  analysis  -  external  capability  is  considered  to  be  better  where  the 
current  in-house  analysis  activity  is  minimal  and  the  size  of  the  enterprise  is  not  large 
enough  to  maintain  analysts  and  analysis  tools. 

•  provider  type  -  the  main  considerations  are  ease  of  access  (physical  or  virtual),  consult¬ 
ant  availability  when  needed,  and  continuity  of  expertise.  Small  consulting  firms  tend  to 
have  higher  staff  turnover  than  large  ones,  and  individuals,  whether  “moonlighting”  or 
not,  tend  to  be  more  tied  up  with  on-going  tasks  than  larger  consulting  firms.  ASPs  are  a 
new  phenomenon:  they  are  certainly  good  candidates  for  providing  “raw”  analysis  capa¬ 
bilities,  but  their  performance  at  other  levels  (e.g.,  idealization  and  interpretation)  has  not 
yet  been  well  established. 

•  timing  of  analysis  -  While  it  may  be  highly  desirable  to  involve  consultants  early  in  the 
design  process,  the  normal  response  time  required  by  the  SME  in  these  early  activities, 
particularly  in  the  “turnkey”  mode,  makes  this  unsuitable,  if  not  impossible.  By  far  the 
most  typical  use  of  analyses  performed  by  consultants  is  for  design  verification  after  the 
detailed  design  is  (essentially)  complete.  With  proper  planning  and  coordination  the  con¬ 
sultant  may  be  brought  in  early  and  given  time  to  develop  a  model  “template”;  then  the 
template  may  be  used  repeatedly  as  the  design  process  unfolds. 

•  consulting  scope  -  The  alternative  scopes  range  from  essentially  full  involvement  by  the 
consultant  to  essentially  full  in-house  involvement,  “farming  out”  only  the  resource¬ 
consuming  “number  crunching”  part  of  the  analysis.  The  choice  will  be  governed  by  the 
extent  of  internal  experience  and  expertise;  typically,  as  this  expertise  develops,  the  de¬ 
pendence  on  outside  consultants  will  decrease. 

•  consulting  breadth  -  If  multiple  domains  are  involved,  it  is  probably  easier  to  manage 
interactions  with  one  consultant  than  with  several  ones;  however,  there  may  be  cases 
where  the  specialized  expertise  needed  in  some  of  the  domains  may  only  be  available 
from  firms  specializing  in  that  domain  only. 

•  disposition  of  legacy  tools  -  Sometimes,  SMEs  may  have  legacy  software  tools  that  are 
in  use  for  in-house  analysis.  These  “home  grown”  tools  reflect  the  SME’s  prior  product 
development  experience,  and  are  often  in  the  form  of  user-developed  software  (e.g.,  do- 
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main-specific  code,  custom  spreadsheets).  It  certainly  does  not  make  sense  to  perform 
in-house  analyses  on  tasks  for  which  a  consultant  has  been  engaged.  (More  appropriately, 
it  does  not  make  sense  to  engage  an  external  consultant  for  tasks  for  which  there  is  avail¬ 
able  in-house  expertise  supported  by  suitable  tools.)  However,  use  of  in-house  tools  may 
continue  in  the  early  design  stages  when  there  is  not  yet  a  sufficiently  detailed  model  to 
turn  over  to  the  consultant.  Furthermore,  these  tools  may  also  be  useful  for  performing 
coarse  or  approximate  checks  on  the  consultant’s  detailed  results;  this  effort  is  imperative 
for  the  SME  to  ensure  adequacy  of  the  consultant’s  analysis. 

TRAINING  NEEDS  AND  OTHER  PREPARATIONS:  In  terms  of  personnel  needs,  even  for 
the  turnkey  mode,  a  few  engineers  knowledgeable  about  the  analysis  task  will  be  needed; 
introductory  seminars  or  short  courses  are  advisable  for  all  engineering  personnel.  Training 
must  be  provided  to  engineers  so  that  they  can  evaluate  analysis  models,  interpret  analysis 
results,  and  accept  analysis  feedback  to  modify  designs  (if  production  time  permits).  Training 
also  must  be  provided  for  CAD  modelers  so  that  they  produce  “good”  geometric  models  con¬ 
forming  to  CAE  tool  needs.  The  engineering  process  must  be  reviewed,  and  if  necessary  ad¬ 
justed,  to  accommodate  the  consultant’s  turnaround  time;  in  the  “turnkey”  mode  this  may  be 
in  the  order  of  weeks.  In  addition  to  process  changes,  management  will  have  to  address  issues 
of  professional  responsibility  and  establish  a  responsibility  chain  for  the  technical  perform¬ 
ance  of  the  products.  Plans  for  future  migration  to  internal  analyses  should  be  in  place  early 
in  the  transition. 


RESULTS  TO  BE  EXPECTED:  More  detailed  and  thorough  analyses  with  up-to-date  analysis 
tools  will  provide  increased  confidence  in  the  performance  of  the  company’s  products.  De¬ 
sign  verification  will  be  less  costly  and  time-consuming  with  the  possible  elimination  of 
some  physical  prototypes.  Templates  of  prototypical  products  will  provide  faster  turnaround 
on  repetitive  product  types.  On  the  other  hand,  analyses  for  innovative  designs  or  new  prod¬ 
uct  configurations  will  be  much  easier  with  proper  analysis  tools.  Design  reuse  will  be  easier 
with  design  and  analysis  data  managed  more  closely.  The  organization  will  find  that  it  can 
automate  substantial  portions  of  the  analysis  process,  becoming  less  dependent  on  the  engi¬ 
neering  experts’  knowledge. 


3.3  From  CAD  and  External  Analyses  to  a  Basic  AEE 

SYNOPSIS  OF  SITUATION.  Engineering  analysis  is  dependent  on  external  contractors,  even 
though  in-house  engineers  have  gained  increased  knowledge  of  CAE  processes,  particularly 
of  how  to  interpret  analysis  results  and  feed  them  back  for  design  enhancement.  The  organi¬ 
zation  recognizes  the  importance  of  engineering  analyses  throughout  the  design  process  and 
is  ready  to  invest  in  CAE  tools  and  personnel. 

SYMPTOMS:  The  number  of  design/analysis  iterations  is  limited  due  to  the  long  turnaround 
cycles.  Design  optimization,  whether  for  performance  or  cost,  is  difficult  to  achieve  due  to 
inefficient  communication  between  designers  and  external  analysts.  Engineering  knowledge 
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is  not  accumulated  systematically  for  future  reuse.  There  are  concerns  about  the  security  of 
proprietary  intellectual  property  communicated  to  the  external  consultants. 


ALTERNATIVES: 

•  The  primary  issue  is  the  “internalization”  of  the  analysis  capability  through  the  installa¬ 
tion  of  a  CAE  system.  The  options  to  be  explored  are  discussed  extensively  in  Volume  I, 
Chapter  4  of  this  report  in  terms  of  the  following  aspects: 

-  choice  of  depth  in  terms  of  levels  of  the  design  process  (e.g.,  conceptual,  pre¬ 
liminary,  detailed)  to  be  supported; 

-  choice  of  breadth  in  terms  of  the  number  and  kinds  of  design  sub-disciplines  to 
be  supported; 

-  choice  of  CAE  components  of  the  environment; 

-  choice  of  component  specialization  (sheet  metal,  injection  molding,  etc.); 

-  choice  of  COTS  products;  and 

-  the  degree  of  customization  that  will  be  required. 

•  Another  issue  involves  personnel  allocation.  As  in  the  case  of  the  CAD  system  selection, 
this  may  be  an  even  harder  choice  than  the  CAE  component  and  COTS  product  selection. 
Again,  the  extreme  points  of  alternatives  are  as  follows: 

-  No  segregation  of  duties:  all  engineers  use  the  CAE  system(s)  on  their  own;  or 

-  Separation  of  functions  between  engineers  and  CAE  analysts. 

DE  CISIONS/E  VAL  UATIONS : 

•  CAE  options  -  See  Volume  I,  Chapter  4  of  this  report  for  a  discussion  of  criteria  and  op¬ 
tions  on  CAE  tool  selection. 

•  Personnel  allocation  -  Choices  regarding  personnel  allocation  should  reflect  the  enter¬ 
prise’s  policies  and  working  conditions.  In  an  informal,  task-  or  project-oriented  engi¬ 
neering  department,  it  makes  sense  to  have  all  engineers  use  the  CAE  tools  directly,  with 
only  a  very  few  full-time  analysts;  in  a  more  hierarchically  structured  or  compartmental¬ 
ized  workplace,  dependence  on  a  dedicated  analyst  group  would  make  more  sense.  In  ei¬ 
ther  organizational  mode,  interaction  between  engineers  and  analysts  can  be  enhanced  by 
providing  “light”  versions  of  the  CAE  tool  to  the  first  group  and  “full-strength”  versions 
of  the  same  tool  to  the  second  group. 

TRAINING  NEEDS  AND  OTHER  PREPARATIONS :  Personnel  decisions  will  include  the  fol¬ 
lowing:  selection  of  allocation  method:  training  and/or  hiring  of  personnel;  decisions  on  spe¬ 
cialization  of  functions  between  analysts  and  designers.  Engineers  must  be  trained  to  build 
and  use  coarse-grained  analysis  models  suitable  for  proposals  and  conceptual  designs.  Engi¬ 
neers  must  also  be  trained  to  use  feedback  from  analysis  results  to  modify  designs  iteratively 
and  to  do  sensitivity  analyses.  The  design  process  will  have  to  be  reviewed  and/or  reorgan¬ 
ized  to  move  analysis  upstream  into  the  early  design  stages  and  to  organize  the  design  proc¬ 
ess  for  design  iterations.  The  organization  must  develop  policies  for  determining  when  a  de¬ 
sign  is  considered  “good  enough”  without  further  iterations.  As  always,  the  firm  has  to  plan 
for  replacement,  upgrades,  and  expansion  of  the  environment. 
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RESULTS  TO  BE  EXPECTED :  The  organization  will  find  that  it  can  set  up  efficient  engi¬ 
neering  processes  with  tools  suited  for  its  specific  need.  It  will  be  able  to  provide  faster  re¬ 
sponses  to  customers’  RFQs  with  demanding  technical  specifications,  thus  gaining  a  competi¬ 
tive  edge  in  the  marketplace.  Design  and  analysis  processes  will  be  coupled,  providing  for 
easier  preparation  of  analyses  and  rapid  turnaround.  It  will  become  easier  to  optimize  designs 
for  performance  and  cost,  and  to  reuse  engineering  knowledge  [Elm  03]. 


3.4  From  Basic  AEE  to  Intermediate  AEE 

SYNOPSIS  OF  SITUATION:  Design  is  driven  primarily  by  geometry:  CAD  models  and  draw¬ 
ings  are  at  the  center  of  the  product  data  representation,  with  analysis  processes  weakly 
linked  to  the  spatial  design.  Design  rationale  is  not  captured  in  the  product  data  representa¬ 
tion.  There  is  no  systematic  creation  and  management  of  a  complete  and  persistent  represen¬ 
tation  of  the  evolving  product  model  from  the  earliest  conceptual  design  steps  to  the  comple¬ 
tion  of  the  detailed  design  and  beyond  to  manufacturing. 


SYMPTOMS:  Design  intent  and  knowledge  applied  are  not  captured  in  the  product  represen¬ 
tation.  Design  reuse  is  difficult  without  access  to  the  design  intent  embedded  in  the  product 
data.  Lack  of  a  central  product  data  model,  encompassing  both  geometry  and  engineering 
function/behavior  information,  makes  sharing  information  between  different  disciplines  inef¬ 
ficient  and  collaboration  hard  to  achieve.  With  the  predominance  of  geometry,  most  engineer¬ 
ing  analysis  activities  can  start  only  after  the  CAD  model  is  fairly  well  developed;  engineer¬ 
ing  activities  are  not  easily  accommodated  during  the  early  stages  of  the  design  evolution 
process. 


ALTERNATIVES:  The  prime  issue  is  the  achievement  of  seamless  two-way  interoperation 
among  all  tools,  the  CAD  tool  included.  This  can  be  achieved  in  three  ways:  direct  tool  inter¬ 
facing,  interfacing  through  translators,  or  interfacing  via  a  database.  The  alternatives  to  ex¬ 
plore  are: 

•  direct  tool  interfacing  through  a  common  “native”  language; 

•  interfacing  through  translators  and/or  neutral  files  e.g.,  STEP,  IGES  (Initial  Graphics  Ex¬ 
change  Specification);  or 

•  interfacing  via  a  database  system;  in  this  case,  further  decisions  must  be  made  on  the 
scope,  location,  and  nature  of  the  database  (it  is  highly  unlikely  that  the  development  of 
such  a  database  system  will  be  a  viable  choice  for  an  SME). 

DE  CISIONS/E  VAL  UATIONS: 

•  Direct  interfacing  -  At  today’s  state  of  technology,  direct  interfacing  through  a  common 
“native”  language  is  possible  only  if  all  tools  are  provided  by  the  same  vendor  or  consor¬ 
tium  of  vendors,  which  is  rarely  the  case  for  a  realistic  array  of  CAD/CAE/CAM  tools. 
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•  Interface  via  translation  -  The  translation-based  interfacing  options  fall  into  two 
classes:  tool-to-tool  two-way  direct  translators,  and  translators  to  and  from  a  central  rep¬ 
resentation,  often  called  “neutral  files.”  A  true  “neutral  file”  capable  of  interfacing  with 
all  tools  used  in  a  firm  would,  in  many  respects,  be  functionally  equivalent  to  the  shared 
database  of  the  next  alternative. 

•  Interface  via  database  -  In  the  database  option,  a  host  of  issues  must  be  addressed.  To¬ 
day,  only  large  corporations  can  dedicate  the  resources  needed  for  building  custom  data¬ 
bases,  and  even  they  have  largely  switched  to  buying  COTS  systems  that  are  ’’tailored” 
by  the  vendor,  or  a  third  party,  for  them.  An  SME  would  typically  be  buying  one  such 
system. 

TRAINING  NEEDS  AND  OTHER  PREPARATIONS :  Personnel  decisions  will  include  train¬ 
ing/hiring  for  specialization  of  functions  (e.g.,  analysts  in  each  domain);  generalized  func¬ 
tions  (e.g.,  designers  knowledgeable  in  several  analysis  domains);  new  specializations  (e.g., 
design  librarian).  Engineers  must  be  trained  to  build  and  reuse  analysis  models  for  proposals 
and  conceptual  designs.  They  will  also  require  training  to  merge  analysis  feedback  from  sev¬ 
eral  domains  to  iteratively  modify  designs  and  to  perform  sensitivity  analyses.  Process  re¬ 
view/  reorganization  decisions  will  include  the  following:  moving  analyses  further  upstream; 
organizing  for  design  reuse;  establishing  timing  and  priorities  among  different  domain  analy¬ 
ses;  establishing  archiving  and  feedback  recording  policies.  Plans  must  be  put  in  place  for 
replacement,  upgrade,  and  environment  expansion. 


RESULTS  TO  BE  EXPECTED :  The  organization  will  be  able  to  create  and  manage  persistent 
representations  of  the  evolving  product  model  from  start  to  finish.  There  will  be  efficient 
support  of  all  engineering  analysis  activities  during  the  entire  design  phase.  Design  reuse  will 
be  dramatically  improved  by  the  shared  storage  of  geometry  and  engineering  design  data. 

The  link  between  design  and  analysis  processes  will  be  tightened  to  the  point  that  integrated 
design  analysis,  function-driven  design  and  multifunctional  design  analysis  can  be  routinely 
performed. 


3.5  Beyond  an  Intermediate  AEE 

SYNOPSIS  OF  SITUATION.  This  is  largely  uncharted  territory,  because  only  a  few  of  the 
largest  manufacturing  enterprises  (e.g.,  in  the  automobile,  aerospace,  and  defense  industries) 
have  reached  a  level  beyond  intermediate,  and  extrapolation  to  SMEs  is  difficult.  Organiza¬ 
tions  at  this  level  typically  maintain  a  representation  of  the  product  model  that  is  independent 
of  the  CAD  system  used  in  its  creation.  This  product  model  contains  the  basic  CAD  model, 
as  well  as  additional  data  capturing  the  design  rationale.  Application-specific  data  may  also 
be  maintained  in  parallel  for  tighter  integration,  mainly  for  analysis  applications.  Extensions 
such  as  PDM  and  catalog  facilities  are  also  generally  used. 


SYMPTOMS :  Product  data  are  effectively  utilized  only  inside  the  design  and  analysis  depart¬ 
ments.  The  environment  does  not  support  a  global  engineering  architecture.  There  is  a  rou- 
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tine  need  for  integrating  internal  and  external  (contracted  out)  designs  and  for  configuration 
management  of  a  complex  product  or  product  suite  over  many  engineering  units,  both  inter¬ 
nal  and  external.  There  are  serious  problems  in  communication  between  the  core  activities 
integrated  into  the  environment  and  various  vertical  and  horizontal  applications  external  to 
the  environment. 

ALTERNATIVES:  The  alternatives  involve  incorporating  new  tools  and/or  new  applications 
into  the  current  environment,  thereby  expanding  the  environment  through  new  components. 
Function-driven  design  tools,  knowledge-based  CAD  systems,  and  multidisciplinary  simula¬ 
tion  and  synthesis  systems  are  potential  examples  in  the  first  category.  Immersive  CAD  tech¬ 
nology,  virtual  manufacturing,  and  collaboration  support  technologies  are  examples  of  AEE 
components  that  may  be  added. 

DECISIONS/EVALUATIONS:  There  is  no  established  precedent  for  selecting  among  the  al¬ 
ternative  expansions  or  their  constituents. 

TRAINING  NEEDS  AND  OTHER  PREPARATIONS :  Again,  there  is  no  established  precedent. 
There  are  training  needs  for  the  new  skills  introduced  by  the  new  components,  and  training 
needs  for  existing  personnel  to  integrate  the  new  tools  in  their  tasks. 

RESULTS  TO  BE  EXPECTED :  Improved  management  of  product  development  processes, 
including  the  creation,  monitoring,  and  modification  of  design  documents  and  databases,  may 
be  expected.  Evaluation  of  the  operability,  manufacturability,  and  maintainability  of  the  pro¬ 
posed  designs  may  be  performed  as  part  of  the  design  process,  enabling  designers  to  predict 
and  address  issues  before  they  arise.  Seamless  sharing  of  product  data  in  a  distributed  and 
heterogeneous  engineering  environment  and  effective  collaboration  through  various  commu¬ 
nication  channels  between  agents  and  repositories  will  become  the  mode  of  operation. 


3.6  Additional  Migration  Considerations 

Two  additional  migration  considerations,  namely,  downstream  data  integration  and  PDM 
adoption,  are  presented  separately  because  they  are  essentially  independent  of  the  level  of  the 
engineering  environment.  The  two  issues  may  be  addressed  at  any  of  the  levels  discussed, 
either  in  conjunction  with  one  of  the  transformations  discussed  above,  or  separately. 


3.6.1  Downstream  Data  Integration 

SYNOPSIS  OF  SITUATION  The  organization  does  not  use  any  CAM  tools,  or  separate  CAD 
and  CAM  tools  are  used  without  careful  consideration  of  their  integration  or  interoperation. 
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SYMPTOMS:  There  is  extensive  rework  in  the  CAD  system  or  manual  entry  to  the  CAM  sys¬ 
tem  because  of  the  presence  of  incompatible  geometric  models,  typically  encountered  late  in 
the  product  delivery  process  when  generation  of  numerical  control  code  for  machine  tools  is 
first  attempted.  Due  to  the  lack  of  linkage  to  the  CAD  system,  machining  operations  that  are 
suboptimal  in  quality,  time  and/or  cost  may  result. 


ALTERNATIVES :  The  issue  is  a  simple  one:  establish  CAD/CAM  integration/interoperation. 
The  alternative  approaches  are  the  following: 

•  shared  platform  for  both  CAD  and  CAM; 

•  interfaced  platforms  with  vendor-supplied  built-in  interfaces; 

•  shared  files  (e.g.,  STEP);  or 

•  integration  via  PDM  (see  below). 

DECISIONS/EVALUATIONS:  The  choice  among  the  alternatives  listed  will  largely  depend  on 
external,  non-technical,  considerations  such  as  the  following: 

•  the  nature  of  engineering/manufacturing  interaction.  If  design  and  manufacturing  are 
tightly  integrated  (in  the  extreme,  no  internal  designs  are  manufactured  outside,  no  exter¬ 
nal  designs  are  manufactured  inside),  a  shared  platform  supplied  and  maintained  by  a  sin¬ 
gle  vendor  makes  more  sense.  At  the  other  extreme,  if  most  of  the  designs  are  “farmed 
out”  for  outside  manufacturing  and/or  manufacturing  produces  mostly  designs  of  outside 
organizations,  shared  files  in  standard  formats  such  as  STEP  may  be  the  most  practical. 

•  familiarity  with  tools  at  both  sites.  If  either  engineering  or  manufacturing  has  long  been 
using  one  tool,  it  makes  sense  to  install  a  shared  or  interfaced  tool  for  both  sites. 

•  the  position  in  the  supply  chain.  Sometimes  the  choice  is  made  for  the  SME  by  a  larger 
client  dictating  the  CAD  or  CAM  tool  to  its  suppliers,  or  a  large  supplier  making  it  ad¬ 
vantageous  to  the  client  to  have  compatible  tools.  This  factor  may  be  less  important  in  the 
future  as  Web  viewing  tools  will  increasingly  provide  translations  as  well. 

TRAINING  NEEDS  AND  OTHER  PREPARATIONS :  For  engineering,  the  primary  personnel 
training/hiring  issue  is  that  of  training  CAD  modelers  to  produce  “good”  design  models  con¬ 
forming  to  CAM  tool  and  production  needs.  Quality  control  and  change  control  policies  and 
their  implementations  must  be  developed  jointly  between  engineering  and  manufacturing. 


RESULTS  TO  BE  EXPECTED :  The  standard  CAD  modeling  practice  previously  used  for 
design  only  will  now  also  result  in  near-flawless  NC  code  generation.  Where  CAM  modeling 
detects  that  the  CAD  models  are  incomplete,  CAD  data-healing  technologies  (i.e.,  COTS 
products  that  identify  and  correct  common  CAD  errors  that  produce  erroneous  CAM  files) 
can  be  utilized. 
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3.6.2  PDM  Adoption 


SYNOPSIS  OF  SITUATION:  The  organization  uses  CAD  (and  possibly  CAM)  tools,  but 
product  data,  documents,  and  drawings  are  dispersed  over  several  systems  and  inefficiently 
managed.  Design  process  management  is  treated  entirely  separately  from  the  management  of 
the  data  generated  and  used  in  that  same  process. 


SYMPTOMS:  It  is  difficult  to  share  design  documents  and  product  data  among  engineers 
working  on  different  stages  or  disciplines  in  the  design  process.  There  may  be  duplicate  data 
inputs  and/or  inconsistencies  among  different  versions  of  the  emerging  product’s  design. 
Separate  design  process  management  and  product  data  management  either  produce  conflicts 
and  contradictions,  or  are  de-emphasized  so  as  not  to  produce  conflicts.  Design  reuse  is  ham¬ 
pered  by  the  separation  of  process  and  product  data. 

ALTERNATIVES:  The  issue  again  is  a  simple  one:  introduce  a  PDM  system  that  integrates 
design  process  management  and  product  data  management.  The  alternatives  to  consider  are 
as  follows: 

•  scope  of  PDM  system 

-  engineering  only; 

-  enterprise-wide;  or 

-  integrated  with  clients  and/or  suppliers. 

•  integration  into  environment 

-  stand-alone  application  (i.e.,  PDM  data  are  entered  and  used  separate  from  engi¬ 
neering  and  manufacturing  applications);  or 

-  integrated  with  CAD/CAE/CAM  tools. 

DECISIONS/EVALUATIONS:  As  with  the  CAD/CAM  integration  discussed  above,  both  the 
choices  of  scope  and  the  manner  of  integration  with  the  design  environment  will  largely  de¬ 
pend  on  external  factors,  primarily  on  the  nature  of  integration  between  engineering  and 
management  and  on  the  organization’s  position  in  the  supply  chain  (see  discussion  above).  A 
separate  PDM  system  makes  little  sense  today  when  so  many  integrated  systems  are  avail¬ 
able.  Access,  via  the  Web,  to  the  client’s  or  supplier’s  PDM  system  makes  sense.  However, 
external  access  to  the  SME’s  engineering  information  must  be  evaluated  and  then  very  care¬ 
fully  controlled  when  such  interfaces  are  provided;  PDM  systems  provide  direct  access  and 
usually  only  monitor  transactions  by  after-the-fact  logging. 


TRAINING  NEEDS  AND  OTHER  PREPARATIONS :  Personnel  hiring/training  decisions  in¬ 
volve  the  personnel  who  will  be  hired  to  run  the  PDM  system  or  who  will  be  retrained  for 
PDM  from  the  organization’s  current  process  management  functions.  The  process  control 
policies  and  their  implementation  must  be  thoroughly  planned  to  obtain  the  maximum  value 
from  the  PDM  integration. 
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RESULTS  TO  BE  EXPECTED :  The  organization  can  expect  the  following:  increased  produc¬ 
tivity;  improved  product  quality  from  fewer  errors  in  product  data  and  the  potential  of  detect¬ 
ing  downstream  quality  problems  early  in  the  design  process;  increased  data  security:  rapid 
availability  of  information  irrespective  of  product  development  stage  or  user  location;  and 
ease  of  search  for  parts  and  documents.  These  benefits  will  accrue  from  better  version  control 
and  document  tracking  provided  by  PDM  systems  as  well  as  better  engineering  process  and 
change  management  introduced  by  the  organization  as  part  of  the  implementation  of  PDM. 


3.7  Migration  Summary 

The  evolution  of  an  organization’s  computing  support  environment  has  been  presented  as  a 
series  of  transformations  between  levels.  Even  if  new  tools  are  introduced  into  a  company’s 
support  environment  on  an  incremental  and  opportunistic  basis,  the  levels  referred  to 
throughout  this  report  represent  fundamentally  different  modes  of  operation  and  philosophi¬ 
cal  outlooks  on  computer-aided  product  development.  The  question  of  what  level  of  the  com¬ 
puting  environment  deserves  to  be  called  an  advanced  engineering  environment  is  moot.  A 
company  that  progresses  two  levels  in  the  hierarchy  presented  here  will  view  its  environment 
as  advanced  in  a  few  years. 
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4  AEE  Component  Selection 


As  discussed  in  Chapter  3,  the  largest  step  in  migrating  from  one  level  of  AEE  to  the  next  is 
the  acquisition  of  a  new  tool  and  the  insertion  of  that  tool  into  the  SME’s  enterprise  and  de¬ 
sign  process.  The  purpose  of  this  chapter  is  to  outline  a  series  of  considerations  that  enter 
into  the  selection  and  acquisition  of  a  tool  to  be  added  to  an  SME’s  engineering  environment. 
The  chapter  presents  only  generic  considerations  that  hold  for  all  the  tools  discussed  in  this 
report,  and  does  not  deal  with  considerations  of  the  specific  selection  criteria  of  classes  of 
tools  (e.g.,  criteria  on  the  types  of  nonlinear  analysis  for  selecting  a  CAE  tool). 

It  is  assumed  that  an  evaluation  of  the  SME’s  needs  has  confirmed  the  technical  basis  for  ac¬ 
quiring  a  tool  within  a  particular  class,  and  that  at  least  a  preliminary  analysis  has  confirmed 
the  economic  viability  of  that  acquisition. 


AEE  component  selection  is  a  multi-criteria  decision-making  problem,  and  almost  every  de¬ 
cision  maker  can  use  some  assistance  in  the  process.  Therefore,  the  chapter  contains  a  brief 
discussion  of  some  of  the  resources  on  which  an  SME  can  draw.  Due  to  the  both  the  impor¬ 
tance  and  the  complexity  of  the  tool  selection  activity,  it  is  important  for  SMEs  to  do  the  fol¬ 
lowing3: 

•  understand  their  businesses  and  how  the  proposed  software  will  support  their  firms’ 
growth  strategy 

•  develop  or  use  processes  to  assign  tasks  and  involve  stakeholders 

•  if  necessary,  involve  specialists  in  decision  support  and  technology  adoption  to  help 
clarify  issues  and  identify  potential  pitfalls 

•  investigate  vendors  and  their  software  offerings  from  a  variety  of  perspectives 

Finally,  there  is  the  issue  of  tool  granularity.  The  selection  criteria  presented  here  tend  to  as¬ 
sume  a  coarse-grained  selection  and  acquisition  process,  e.g.,  selecting  a  CAD  tool  or  a  PDM 
tool,  in  a  process  similar  to  selecting  a  drafting  table  or  a  file  cabinet.  Today’s  AEE  compo¬ 
nent  tools  are  closely  interfaced  and  bundled,  and  the  choices  to  be  made  tend  to  be  more 
fine-grained.  The  technical  capability  that  one  wishes  to  acquire  may  be  available  as  an  up¬ 
grade  of  or  an  add-on  to  one  of  the  tools  in  the  SME’s  current  “toolbox.”  This  fact  may  result 
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in  having  to  make  much  more  heterogeneous  choices,  comparing  add-ons  for  existing  tools  to 
brand  new  tools. 


4.1  Selection  Criteria 

4.1.1  Technical  Criteria 

Key  technical  criteria  for  the  selection  of  an  AEE  component  include  functionality,  interop¬ 
erability,  usability,  and  expandability. 

4.1. 1.1  Functionality 

Clearly,  the  first  criterion  for  selecting  an  AEE  component,  or  evaluating  a  potential  compo¬ 
nent,  is  that  it  provides  the  functionality  that  is  needed  by  the  organization.  The  SAT-ETC 
discussed  in  Chapter  2  is  designed  specifically  to  elicit  some  of  the  potential  needs  of  an 
SME,  and  should  be  consulted  first.  However,  the  SAT-ETC  can  obviously  never  be  com¬ 
plete,  and  the  SME  will  generally  identify  additional  functionalities  needed  beyond  those  ad¬ 
dressed  by  the  SAT-ETC.  Reviews  of  past  designs  and  of  their  documentation,  as  well  as 
discussions  with  designers  and  engineers  are  some  of  the  means  for  identifying  needed  func¬ 
tionalities  in-house.  Tabular  comparisons  of  AEE  component  features  and  vendor  literature 
and  presentations  are  the  key  means  for  establishing  whether  the  components  offered  provide 
the  functionality  needed. 

In  defining  the  needed  functionality,  it  is  important  to  consider  an  appropriate  time  frame  for 
the  AEE  component  or  tool  being  considered.  Obviously,  for  investing  in  the  purchase  of  an 
AEE  component  and  the  larger  expense  of  providing  adequate  staff  training  in  the  use  of  the 
tool,  the  SME  wants  more  functionality  than  just  that  needed  to  attack  today’s  problems.  It  is 
necessary  to  do  some  projection  to  identify  future  needs  and  future  business  potentials  that 
may  be  met  by  the  added  functionality.  If  available,  records  of  past  RFQs  not  responded  to  or 
proposals  rejected  by  the  client  may  be  excellent  sources  of  information  on  missed  opportuni¬ 
ties,  which  may  be  due,  at  least  in  part,  to  inadequate  functionality. 


On  the  other  hand,  it  is  unrealistic  to  plan  for  too  long  a  time  horizon,  for  two  reasons: 

1 .  Internally,  long-run  business  opportunities  and  directions  become  too  diffuse  to  influ¬ 
ence  specific  tool  selections. 

2.  Externally,  the  AEE  tool  vendor  market  is  probably  changing  faster  than  the  SME’s 
business  environment,  making  long-range  projection  difficult.  New  functionalities  re¬ 
quested  by  a  substantial  segment  of  a  tool  vendor’s  users  tend  to  become  available  in 
subsequent  releases  and  versions.  Mergers  and  teaming  arrangements  among  vendors 
bring  functionalities  previously  available  only  in  separate  tools  into  one  environment. 
New  technical  developments,  and  the  software  industry’s  responses  to  them,  make  en¬ 
tirely  new  components  available  to  the  SME. 
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In  summary,  the  SME  must  develop  a  precise  list  of  needed  and  desired  functional  capabili¬ 
ties  for  a  new  AEE  tool,  derived  from  an  analysis  of  current  and  expected  future  needs,  but 
tempered  by  a  judicious  evaluation  of  potential  changes  both  in  the  SME’s  business  and  in 
the  software  vendor  industry.  Candidate  components  can  then  be  evaluated  against  such  a 
list. 

4.1. 1.2  Interoperability 

The  major  theme  of  this  report  is  encapsulated  below: 


Advanced  Engineering  Environments  (AEEs),  through  which  people  and  tools  can 
effectively  interoperate  in  the  delivery  of  engineering  products  and  services,  are 
becoming  feasible  even  for  the  smallest  SME. 

In  the  world  of  SMEs  today,  interoperability  ranks  a  close  second  to  functionality  as  a  tool 
selection  criterion.  The  day  of  the  independent  tool  is  long  gone.  SMEs  are  no  longer  will¬ 
ing  to  manually  copy  the  output  of  one  tool  to  serve  as  the  input  of  the  next  tool — an  effort 
that  is  neither  productive,  cost-effective,  nor  accurate,  albeit  a  practice  all  too  common  in  the 
early  days  of  computer  use. 

Interoperability  among  tools  can  be  achieved  in  a  variety  of  ways.  Among  the  modes  of  in¬ 
teroperation  discussed  in  Chapter  5  of  Volume  I  [Fenves  03]  of  this  report  series  and  identi¬ 
fied  in  the  two  assessment  tools  presented  in  Chapter  2  of  the  current  volume  are 

•  tools  communicating  in  a  ‘native  mode’; 

•  tools  interfaced  through  common  files  (STEP  or  other  standard  or  neutral  format); 

•  tools  interfaced  through  a  shared  database; 

•  tools  integrated  (by  their  vendors)  over  a  common  shared  database;  and 

•  one  tool  operating  within  another. 

The  most  important  criterion  in  selecting  among  competing  tools  on  the  basis  of  interopera¬ 
bility  considerations  is  the  degree  to  which  the  interoperation  mode  offered  by  the  tools  sup¬ 
ports  the  organization’s  overall  product  development  process.  A  pair  of  illustrative  compari¬ 
sons  will  make  this  point  clearer.  On  the  one  hand,  assume  that  an  SME  separates  the 
concerns  of  its  design  and  manufacturing  divisions  to  the  point  where  for  each  product  only 
one  data  transfer  takes  place  from  the  CAD  system  to  the  CAM  system  at  the  completion  of 
the  design  process,  in  waterfall  fashion.  In  this  case,  even  the  slowest  transfer  mode  is  satis¬ 
factory.  On  the  other  hand,  assume  a  different  organizational  structure  or  process,  where  the 
manufacturing  division  enters  early  in  the  design  process  and  emergent  designs  are  frequently 
sent  to  the  manufacturing  division  for  evaluation  and  feedback  on  manufacturability  issues. 

In  this  case,  the  SME  needs  a  data  transfer  mode  and  a  communication  interface  that  reduces 
the  delays  in  the  feedback  loop  to  a  minimum.  Such  intimate  interaction  can  be  achieved  if 
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there  are  no  translations  to  be  made,  so  that  two  engineers  can  look  at  the  same  model  at  the 
same  time  and  discuss  costs  and  changes.  A  similar  distinction  applies  to  CAE  tools  used 
once  per  product  for  final  verification  vs.  CAE  tools  iteratively  used  in  the  design  process  for 
frequent  performance  evaluation  or  optimization  of  the  product  as  it  is  being  designed. 

When  interoperation  becomes  intimate,  as  in  the  second  alternative  of  the  above  illustrations, 
a  second  interoperability  criterion  emerges.  In  the  waterfall  CAD/CAM  and  CAD/CAE  sce¬ 
narios,  the  two  sets  of  specialists  that  use  the  two  tools  interact  so  seldom  that  it  does  not 
matter  much  whether  the  models  within  the  respective  tools  are  understandable  to  the  other 
discipline  or  not.  Human  interaction  is  primarily  face-to-face  or  through  drawings,  plots, 

Web  pages  or  e-mail  messages.  All  of  these  “data  transfer  modes”  are  much  more  flexible 
and  redundant  than  direct  transfers  between  tools.  As  the  interaction  becomes  more  intimate, 
it  becomes  increasingly  important  that  the  computer-based  models  used  by  the  tools  be  un¬ 
derstandable,  to  some  degree  at  least,  to  the  specialists  in  the  interacting  disciplines.  Other¬ 
wise,  the  potential  offered  by  rapid  iterations  in  the  design  process  will  not  be  fully  exploited, 
as  people  have  to  slow  down  to  mentally  translate  strange  models  into  their  own  terms. 

Whenever  translation  between  computer-based  models  is  involved,  regardless  of  the  transfer 
rate,  a  third  interoperability  criterion  emerges,  that  of  translation  fidelity.  Fidelity  is  a  meas¬ 
ure  of  the  extent  to  which  the  tool  receiving  the  translated  data  can  construct  a  complete  and 
faithful  computer-based  model  for  its  own  purposes,  without  loss  of  information.  It  is  a  com¬ 
plex  function  of  the  representations  used  by  the  interoperating  tools  and  the  comprehensive¬ 
ness  of  the  translator  program.  Loss  of  fidelity  in  transfer  can  have  serious  technical  and  fi¬ 
nancial  implications,  and  should  be  extensively  tested  as  part  of  the  tool  selection  process. 

4.1. 1.3  Usability 

It  is  a  truism  that  a  tool  must  be  usable  in  order  to  be  effectively,  even  enthusiastically,  used. 
At  the  basic  level,  the  layout  of  the  interfaces,  the  function  and  location  of  various  control 
features,  and  the  familiarity  of  the  “look  and  feel”  of  the  tool  are  usability  criteria  for  every 
computer-based  tool.  Software  vendors  and  universities  have  gained  increased  understanding 
of  human-computer  interaction  issues  and  principles  and  this  knowledge  has  significantly 
improved  tool  interfaces. 

For  technical  tools,  such  as  CAD,  CAM  and  CAE  tools,  there  are  two  additional  usability 
criteria.  First,  users  insist  that  the  user  interface  of  the  tool  and  the  way  of  specifying  actions 
by  the  tool  be  “intuitive.”  This  imprecise  term  means  that  the  consequences  of  specifying  an 
action  to  the  tool,  and  the  responses  displayed  by  the  tool,  should  be  what  the  user  expects, 
based  on  his/her  education,  training,  and  experience  with  previous  tools  of  the  same  class. 

Second,  technical  users  expect  that  the  tool  be  “transparent”  to  some  extent,  and  not  a  “black 
box.”  A  black  box  does  not  reveal  anything  about  its  inner  workings;  input  goes  in  and  out- 
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put  comes  out,  with  the  user  left  totally  in  the  dark  on  how  the  latter  was  derived  from  the 
former.  In  contrast,  a  transparent  program  makes  some  attempt  to  explain  its  reasoning  in  a 
terminology  familiar  to  the  user.  Full  transparency  is  not  easy  to  achieve,  and  may  even  be 
counterproductive.  The  user  does  not  expect  a  CAE  tool  implementing  finite  element  analy¬ 
sis  to  display  all  of  its  intermediate  steps;  but  he/she  has  the  right  to  expect  occasional  status 
messages  (“assembling  stiffness  matrix,”  “solving  equations,”  etc.)  and  query  capabilities  for 
intermediate  results  or  checks. 

4.1. 1.4  Expandability 

The  last  set  of  technical  selection  criteria  deals  with  the  manner  in  which  the  tool’s  functional 
capabilities  may  be  expanded  in  the  future.  Expandability  has  two  aspects:  external  and  in¬ 
ternal.  External  expandability  pertains  to  what  may  be  obtained  from  the  vendor:  the  ex¬ 
panded  functional  capabilities  that  may  be  added  in  the  future  when  needed,  and  what  the 
expansion  entails.  As  indicated  repeatedly  in  the  two  volumes  of  this  report  series,  many 
vendors  provide  both  light-duty  and  heavy-duty  versions  of  their  tools  as  a  means  of  expand¬ 
ing  the  tool’s  scope.  In  other  cases,  vendors  or  third-party  suppliers  provide  add-ons  to  in¬ 
crease  tool  functionalities.  The  evaluation  criteria  for  external  expandability  thus  need  to 
address  three  distinct  issues:  (1)  the  expanded  capabilities  available;  (2)  the  effort  required  to 
install  the  needed  expansion(s);  and  (3)  the  type  of  compatibility  to  be  maintained  between 
the  original  and  expanded  versions  of  the  tool. 


Internal  expandability  deals  with  the  changes  that  individual  users,  or  the  SME  organization 
on  the  whole,  may  make  to  expand  the  usability  or  utility  of  the  tool.  This  type  of  expansion 
is  often  referred  to  as  “customization.”  For  example,  CAD  tools  may  be  customized  by  in¬ 
serting  parts  libraries,  scripts  for  defining  custom  entities,  linkages  to  databases  of  non¬ 
geometric  attributes,  etc.  Obviously,  some  classes  of  tools  are  inherently  more  customizable 
than  others.  At  one  extreme,  spreadsheets  are  eminently  customizable,  as  they  support  essen¬ 
tially  any  operation  on  tabular  data.  On  the  other  hand,  production-oriented  CAE  tools,  in 
contrast  to  research  tools,  cannot  be  expected  to  be  highly  customizable.  It  is  important  to 
establish  in  advance  of  tool  selection  the  kinds  of  customization,  compatible  with  the  nature 
of  the  tool,  that  is  needed  or  desired,  and  evaluate  candidate  tools  against  this  list.  Determin¬ 
ing  whether  the  vendor  will  continue  support  following  SME  customization  is  also  advised. 


4.1.2  Service  Criteria 

4.1. 2.1  Vendor  Support  and  Training 

The  single  most  important  non-technical  criterion  for  selecting  a  tool  is  the  extent  of  the  ven¬ 
dor’s  commitment  to  provide  support  and  training  prior,  during,  and  after  installation  of  the 
selected  tool  and  after  any  customization  by  the  SME.  Such  support  and  training  are  essen¬ 
tial  for  all  levels  of  tools.  Clerical  and  data  entry  personnel  must  be  trained  and  supported  so 
as  to  be  able  to  execute  all  tasks  within  their  domains  with  dispatch  and  confidence;  they 
cannot  be  expected  to  experiment  with  alternate  approaches  when  a  tool  malfunction  occurs. 
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Engineers  and  designers,  through  their  technical  background,  are  more  willing  to  experiment 
and  even  to  try  to  “break  the  tool.”  On  the  other  hand,  they  need  extensive  training,  opportu¬ 
nities  to  experiment,  and  a  wide  set  of  examples  to  work  on  until  they  have  “internalized”  the 
tool  to  the  point  where  they  are  willing  to  make  professional  decisions  based  on  the  results 
from  the  tool.  The  need  for  this  type  of  advanced  professional  training  cannot  be  overempha¬ 
sized. 

The  vendor’s  ability  to  deliver  the  kinds  of  support  described  above  needs  to  be  clearly  de¬ 
termined,  and  its  track  record  explored.  The  relationship  between  users  and  vendors  is  in¬ 
creasingly  becoming  one  of  partnering.  The  SME  needs  to  recognize  that  its  continued  capa¬ 
bility  to  profitably  deliver  products  or  services  is  increasingly  dependent  on  an  outside  entity, 
the  tool  vendor.  With  the  startups,  acquisitions  and  mergers  taking  place  in  the  software  in¬ 
dustry,  the  future  of  this  partnership  is  at  least  as  difficult  to  predict  as  the  future  technical 
needs.  Nevertheless,  predictions  must  be  made  and  candidates  must  be  evaluated  on  this  ba¬ 
sis  as  well.  See  the  technical  note  Selecting  Advanced  Software  Technology  in  Two  Small 
Manufacturing  Enterprises  (Chapter  4  and  Appendix  C)  for  additional  reading  on  selecting 
vendors.4 

4.1. 2.2  Staff  Interests 

Computer-based  tools  are  not  deployed  in  a  vacuum.  Continued  and  effective  use  of  a  tool 
requires  that  the  personnel  using  it  be  actively  involved  in  its  acquisition,  installation,  use, 
and  upgrading,  when  needed.  Users  need  to  feel  that  they  are  empowered  by  the  tool,  that 
their  professional  stature  is  raised  and  that  their  performance  is  qualitatively  and  quantita¬ 
tively  improved.  The  quality  and  level  of  tools  available  is  increasingly  becoming  a  staff  re¬ 
tention  issue,  after  having  been  a  staff  recruiting  issue  for  some  time. 

It  is  difficult  to  give  crisp  and  precise  selection  criteria  for  staff  interests.  The  best  way  to 
incorporate  staff  concerns  in  the  selection  and  evaluation  process  is  to  have  a  broad  segment 
of  the  intended  user  population,  from  senior  members  to  novices,  participate  actively  in  the 
process. 

4.1. 2. 3  Cost 

Cost  is  an  obvious  selection  criterion,  but  seldom  is  it  a  discriminating  criterion  for  selection 
among  candidate  tools  of  the  same  class  and  with  roughly  the  same  set  of  capabilities.  This 
is  because  of  two  factors.  First,  the  software  market  tends  to  self-calibrate,  so  that  compara¬ 
ble  tools  have  comparable  prices,  with  only  occasional  exceptions.  Second,  the  internal  costs 
for  staff  training,  process  adjustment,  and  so  on,  will  essentially  be  the  same  for  any  tool  in 
its  class. 


32 


Anderson,  W.;  Estrin,  L.;  &  Buhman,  C.  Selecting  Advanced  Software  Technology  in  Two  Small 
Manufacturing  Enterprises.  Pittsburgh,  PA:  Software  Engineering  Institute,  Carnegie  Mellon  In¬ 
stitute.  To  be  published. 


CM  U/SE I-2004-TR-007 


In  developing  the  costs  associated  with  the  installation  of  a  new  tool,  it  is  important  that  the 
development  be  comprehensive.  Out-of-pocket  costs,  including  the  cost  of  purchase,  any 
modifications  needed  to  the  previous  environment,  additional  space,  furniture,  even  the  direct 
costs  of  initial  staff  training,  are  generally  easy  to  obtain.  Many  organizations  simply  stop 
with  such  a  list.  What  tends  to  be  forgotten  is  the  cost  of  providing  the  affected  staff  with 
time  and  resources  to  study,  explore,  and  experiment  with  a  tool  until  each  staff  member  feels 
fully  competent  to  use  the  tool  and  make  professional  choices  and  recommendations  based  on 
the  results  produced  by  the  tool.  Organizations  that  don’t  plan  and  budget  for  these  costs 
tend  not  to  provide  the  released  learning  time  needed.  The  affected  staff  members  must  boot¬ 
leg  the  learning  into  other  tasks,  or  are  forced  to  make  decisions  they  feel  they  are  not  quali¬ 
fied  to  make.  Finally,  ongoing  support  costs  such  as  annual  license  fees,  service  contracts, 
software  upgrades,  and  so  on,  must  not  be  forgotten. 


4.2  Selection  Resources 

It  is  clear  from  the  presentation  above  that  many  categories  of  decision  making  are  combined 
in  developing  a  set  of  tool  selection  criteria  and  then  selecting  from  among  the  identified 
candidates.  There  are  several  categories  of  resources  that  an  SME  can  tap  to  assist  its  deci¬ 
sion  making,  briefly  summarized  below.  The  SEI  Evolutionary  Process  for  Integrating 
COTS-based  systems  (EPIC)  method  and  a  technical  report  by  Anderson5  present  assessment 
instruments  that  address  these  multiple  categories  [Albert  02]. 


4.2.1  Web-Based  Information  Resources 

In  the  early  days  of  computing  in  engineering  and  manufacturing,  user  groups  developed 
around  hardware  platforms  and  major  tools  (then  simply  called  programs).  The  advice  and 
assistance  provided  by  these  peer  groups  were  enormously  helpful  in  fostering  the  culture  of 
computer  use  among  the  pioneering  organizations.  Today,  advice  and  counsel  of  trusted 
peers  is  still  very  valuable.  With  the  spread  of  computing,  the  peer  community  has  greatly 
expanded,  and  peer  group  organizations  have  largely  disappeared.  On  the  other  hand,  IT 
networks  and  the  World  Wide  Net  have  brought  communities  together.  There  are  numerous 
forums,  chat  rooms,  on-line  newsletters,  and  so  forth,  with  subject  matters  relevant  to  every 
aspect  of  engineering  environments  and  their  constituent  tools.  Access  to  a  few  of  these  sites 
can  provide  useful  input  to  tool  selection. 


4.2.2  Magazines  and  Journals 

Most  technical  journals  dealing  with  engineering  and  manufacturing  that  cover  these  fields, 
particularly  the  trade  magazines  distributed  free  to  qualified  subscribers,  provide  two  kinds  of 
features  germane  to  tool  selection.  First,  many  of  these  publications  provide,  on  a  periodic 


5  Anderson,  Selecting  (see  note  4). 


CMU/SEI-2004-TR-007 


33 


basis,  tabular  summaries  and  comparisons  of  capabilities  of  classes  of  tools.  Software  ven¬ 
dors  make  sure  that  their  products  appear  in  these  summaries,  so  that  the  coverage  of  these 
summaries  is  generally  quite  complete.  A  recent  summary  table  for  a  particular  class  of  tools 
is  valuable  for  the  SME  in  (1)  identifying  some  of  the  major  tool  evaluation  and  selection 
criteria;  (2)  identifying  potential  vendors;  and  (3)  pruning  the  list  of  candidates  to  consider  by 
eliminating  those  with  tabulated  capabilities  outside  the  intended  envelope.  Second,  most 
publications  provide  occasional  software  reviews  or  feature  articles  describing,  in  some 
depth,  capabilities  of  a  new  or  significantly  revised  tool.  Good  reviews  in  this  category,  par¬ 
ticularly  the  ones  written  in  the  first  person,  provide  a  vivid  picture  of  the  strengths  and 
weaknesses  of  the  tools  described.  Reviews  of  the  top  candidate  tools  in  a  selection  process 
can  aid  significantly  in  their  evaluation. 


4.2.3  Trade  Shows 

The  opportunity  to  “check  the  teeth”  or  “kick  the  tires”  of  candidate  purchases  has  tradition¬ 
ally  been  part  of  the  selection  process.  The  equivalent  of  these  rituals  for  computer-based 
tools  is  the  trade  show.  These  are  either  stand-alone  events  or  attached  to  other  professional 
or  trade  group  meetings.  Here,  booths  display  the  newest  versions  of  tools,  and  ancillary 
events  provide  short  courses,  discussion  and  question-and-answer  sessions,  and  so  forth.  At 
such  shows,  SMEs  can  gather  just  about  any  kind  of  information  on  tools  of  interest,  as  well 
as  contacts  with  many  sources  of  further  information.  The  presence  of  so  many  competing 
products  in  one  place  can  be  overwhelming,  and  two  points  of  advice  are  in  order.  First,  you 
have  to  go  to  such  shows  prepared.  The  amount  of  information  you  can  glean  by  stopping  at 
a  booth  is  limited;  furthermore,  the  interface  features  of  all  tools  in  a  given  category  are  today 
so  “homogenized”  that  a  brief  look  will  not  identify  any  differentiating  characteristic  among 
the  tools.  Therefore,  you  have  to  have  made  some  preliminary  pruning  and  you  have  to  re¬ 
solve  to  examine  in  some  detail  no  more  than  a  handful  of  the  top  candidates.  Second,  you 
have  to  be  ready  for  surprises.  A  new  tool  or  new  feature  of  an  existing  tool,  first  unveiled  at 
the  trade  show,  may  counteract  even  the  best  preparation  and  alter  the  list  or  previous  ranking 
of  candidates.  A  good  strategy  to  follow  is  to  watch  for  booths  surrounded  by  large  crowds 
and  to  check  these  out  for  relevance. 

4.2.4  Consulting  Services 

Finally,  there  is  a  whole  range  of  consulting  services  that  an  SME  may  purchase  to  assist  in 
the  tool  selection  and  evaluation  process.  These  services  range  from  the  preparation  of  selec¬ 
tion  criteria  and  ranking  of  candidate  tools  accordingly  to  full  tool  selection,  installation,  and 
the  necessary  staff  training. 
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4.3  Tool  Selection  Summary 

Technical  criteria  for  selecting  a  tool  to  be  added  to  the  SME’s  engineering  environments  in¬ 
clude  the  following: 

•  functional  capabilities  of  the  tool,  based  on  current  and  expected  future  needs,  but  taking 
into  account  potential  changes  in  business  and  software; 

•  interoperability  appropriate  to  support  the  organization’s  overall  product  development 
process; 

•  usability,  particularly  the  extent  to  which  the  tool  is  deemed  “intuitive”  and  reasonably 
“transparent”  by  its  potential  users;  and 

•  expandability,  in  terms  of  tool  features  that  may  be  subsequently  added  and  customiza¬ 
tion  that  users  may  apply  to  extend  the  tool’s  capabilities. 

Service  criteria  to  consider  include  the  factors  below: 

•  extent  of  support  and  training  provided  by  the  vendor; 

•  match  between  the  interests  of  the  affected  users  and  the  tool’s  capabilities;  and 

•  cost,  including  out-of-pocket  costs  for  purchase,  installation,  and  training,  and  internal 
costs  for  adequate  user  experimentation  and  learning. 

The  resources  available  to  assist  in  making  tool  selections  include  the  following: 

•  Web-based  sources  such  as  forums  and  chat  rooms; 

•  summary  tabular  comparisons  of  tools  and  feature  articles  on  specific  tools  in  profes¬ 
sional  and  trade  publications; 

•  trade  shows  demonstrating  the  tools;  and 

•  consulting  services. 
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5  AEE  Technology  Adoption 


A  typical  technology  installation  process  contains  steps  such  as  choosing  the  technology 
product,  acquiring  it,  physically  installing  it  in  the  work  environment,  and  training  operators 
in  how  to  use  the  system  (which  may  or  may  not  match  their  current  procedures).  While  all 
of  these  actions  are  necessary  to  incorporate  a  new  technology  into  an  SME,  they  are  not  suf¬ 
ficient,  and  will  not  produce  the  desired  benefits  until  the  SME  adopts  the  technology  and 
integrates  it  into  its  operation. 

Technology  adoption  is  achieved  when  the  people  who  need  to  use  the  new  technology 

•  are  aware  of  the  presence  and  the  status  of  the  technology; 

•  have  appropriate  access  to  it; 

•  are  trained  to  use  it; 

•  get  support  for  using  it;  and 

•  actually  do  use  it  to  support  their  work  tasks  [Garcia  02]. 

5.1  The  Adoption  Challenge 

The  benefits  of  AEE  adoption  by  SMEs  are  many  (see  Volume  I,  Chapter  3),  and  yet  many 
SMEs  remain  reluctant  to  adopt  advanced  software -based  technologies  [Fenves  03].  In  many 
cases,  this  reluctance  may  be  traced  to  prior  experience  with  unsuccessful  software  adoptions. 

Technology  adoption  is  rarely  achieved  without  challenge.  While  a  new  technology  is  intro¬ 
duced,  the  every  day  work  of  the  organization  must  continue.  Therefore,  the  adoption  effort 
is  superimposed  upon  normal  workday  activities.  As  the  technology  is  introduced,  the  or¬ 
ganization  may  face  challenges  such  as  the  following 

•  Diverting  critical  resources  from  ongoing  production  activities  to  technology  analysis  and 
selection  activities; 

•  Diverting  critical  production  resources  for  training; 

•  Modifying  time-tested  work  practices  to  utilize  the  capabilities  of  the  new  technology; 

•  Changing  the  skill  sets  within  the  organization  to  accommodate  the  installation,  utiliza¬ 
tion,  and  support  of  the  new  technology;  and/or 

•  Overcoming  the  common  human  resistance  to  change. 
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These  challenges  can  affect  the  performance  of  the  organization,  as  illustrated  in  Figure  4 
[Garcia  02]. 


Figure  4:  The  Impact  of  Technology  Adoption 


Change  is  difficult  for  people  and  for  organizations.  Technology  adoption  is  synonymous 
with  change:  a  change  of  technology;  a  change  of  users’  skills;  a  change  in  the  way  work  is 
done. 


There  is  nothing  more  difficult  to  take  in  hand ,  more  perilous  to  conduct  or  more 
uncertain  in  its  success  than  to  take  the  lead  in  the  introduction  of  a  new  order. 

Niccolo  Machiavelli:  The  Prince,  1515 
[Machiavelli  15] 

One  method  of  reducing  the  fear  of  change  and  improving  the  probability  of  successful  tech¬ 
nology  adoption  is  to  implement  adoption  via  an  orderly  process  that  achieves  the  following: 

•  exposes  the  need  for  change  to  all  of  the  stakeholders; 

•  involves  the  stakeholders  in  the  development  of  the  adoption  plan; 

•  defines  the  future  state  of  the  organization  after  the  adoption; 

•  maps  the  path  from  the  present  state  to  the  future  state  for  all  to  see; 

•  identifies  and  addresses  anticipated  barriers  to  technology  adoption  [Estrin  03];  and 

•  minimizes  the  risks  of  technology  adoption. 
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5.2  The  Technology  Adoption  Process 

The  goal  of  technology  adoption  is  improvement  of  operations  and  process,  an  area  of  study 
addressed  vigorously  since  the  1920s.  The  Shewart  Cycle  and  the  Initiate,  Diagnose,  Estab¬ 
lish,  Act,  and  Leverage  (IDEAL)  model  (not  elaborated  here)  are  among  the  many  process 
improvement  models  that  exist  today  [Shewart  39,  McFeeley  96].  The  remainder  of  this 
chapter  will  discuss  technology  adoption  using  a  modification  of  the  Shewart  Cycle. 

The  Shewart  Cycle  is  an  early  model  developed  for  process  improvement.  Although  its  crea¬ 
tion  predates  the  existence  of  software,  it  remains  fully  applicable  to  software -based  technol¬ 
ogy  adoption  today.  The  Shewart  Cycle  was  later  articulated  by  W.  Edwards  Demming  as 
“Plan,  Do,  Study,  Act”  [Demming  82].  Presently,  the  universally  accepted  nomenclature  is 
“Plan,  Do,  Check,  Act”  or  PDCA.  These  four  activities  comprise  a  method  for  achieving 
continuous  process  improvement.  The  four  steps  are  described  as  follows: 

Plan:  Define  a  plan  for  a  new  process  or  improvements  to  an  existing  process.  This 

plan  must  include  monitoring  and  data  collection  methods  as  well  as  performance 
objectives. 

Do:  Implement  the  proposed  changes  on  a  small  scale,  perhaps  as  a  pilot  project.  Ob¬ 

tain  performance  measurements  before,  during,  and  after  the  pilot. 

Check:  Study  the  measurements  collected  during  the  pilot.  Analyze  the  results  to  identify 
and  understand  failures  and  successes.  Determine  the  “lessons  learned”  during 
the  pilot. 

Act:  Act  to  apply  the  conclusions  of  the  prior  analysis. 

NOTE:  Based  upon  this  analysis,  acceptable  actions  may  range  from  full-scale 
implementation  of  the  process  change,  to  a  restart  of  the  Shewart  cycle,  to  aban¬ 
donment  of  the  process  change. 

This  process  is  illustrated  in  Figure  5. 


CMU/SEI-2004-TR-007 


39 


Determine 

Effectiveness 


Define  the  Problem 


Implement 
System  Change 


Evaluate 


Collect  Data 


State  Improvement 
Objectives 


Identify  Possible 
Causes  of  Problem 


Establish  Baselines 


Test  Change 


Figure  5:  She  wart  Cycle 
[Demming  82] 


A  derivative  of  this  process  specifically  adapted  for  technology  adoption  is  shown  in  Figure  6 
[Garcia  03].  This  figure  represents  one  PDCA  cycle. 
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Figure  6:  Technology  Adoption  Process 


The  six  phases  of  this  technology  adoption  process  are  as  follows: 

1.  Understand  existing  company  environment; 

2.  Establish  Technology  Adoption  Project  Goals  &  Metrics; 

3.  Evaluate  Technology  Options; 
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4.  Obtain  Technology; 

5.  Implement  and  Adopt  Technology;  and 

6.  Analyze  &  Deliver  Adoption  Results. 

These  phases  are  described  in  detail  in  the  following  sections. 


5.2.1  Understand  Existing  Company  Environment 

The  Technology  Adoption  Process  of  Figure  6  focuses  significant  attention  on  the  planning 
phase  of  technology  adoption.  Research  has  shown  that  this  is  of  critical  importance  to 
SMEs  because  they  tend  to  rely  on  informal  rules  and  infrastructures,  often  depending  on 
“tribal”  knowledge  (i.e.,  a  mixture  of  experience  and  expertise  transmitted  from  one  worker 
to  another).  Rules  or  infrastructures  for  decision  making  are  often  fuzzy.  Documentation  and 
communication  of  operating  procedures  to  employees  and/or  vendors  is  often  unclear.  This 
absence  of  defined  processes  generates  challenges  in  both  the  prediction  of  the  effects  of 
software  technology  adoption  and  the  adoption  execution  itself  [Estrin  03]. 

To  address  these  limitations  the  Technology  Adoption  Process  uses  a  four-step  method  to  de¬ 
velop  an  understanding  of  the  SMEs  environment. 

1.  Define  Initial  Requirements 

To  initiate  a  technology  adoption,  the  stakeholders  within  the  organization  first  define  busi¬ 
ness  and  technical  needs  to  be  addressed.  This  is  done  based  upon  the  following: 

•  identification  of  the  problem  to  be  addressed; 

•  company  vision; 

•  stakeholder  input;  and 

•  general  understanding  of  the  company  external  business  environment  (competitors,  mar¬ 
ket  drivers,  technology  advances,  etc.). 

This  effort  results  in  a  statement  of  requirements  and  the  assignment  of  resources  for  further 
effort  on  the  project. 

2.  Analyze  Workflow 

An  early  task  of  the  project  team  is  to  document  the  organization’s  “as-is”  business  processes 
relevant  to  the  problem  being  addressed.  This  involves  identifying  process  steps  and  work 
products  related  to  the  problem.  Research  is  based  upon  company  process  documents,  tech¬ 
nology  improvement  requirements,  company  employee  interviews,  and  so  forth.  The  effort 
results  in  a  description  of  the  current  company  process(es).  This  is  useful  in  understanding 
the  role  of  the  potential  technology  adoption,  and  also  provides  a  baseline  against  which  im¬ 
provement  can  be  measured. 
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3.  Identify  Metrics 


Performance  measures  must  be  defined  to  enable  monitoring  of  progress  and  recognition  of 
success.  For  SMEs,  this  is  typically  tied  to  how  managers  communicate  company  perform¬ 
ance  to  owners  /  executives.  Metrics  are  typically  derived  from  the  improvement  require¬ 
ments,  the  “as-is”  process  description,  input  from  stakeholders,  and  so  forth. 

4.  Baseline  Organizational  Adoption  Factors 

Technology  adoption  can  be  viewed  as  a  convergence  of  technology,  organization,  and  peo¬ 
ple;  that  is,  people  operating  within  an  organization  to  incorporate  a  new  technology  into 
their  daily  routine.  The  sociological  and  organizational  context  of  the  technology  adoption  is 
often  a  key  factor  in  developing  a  technology  adoption  plan  defining  the  application  of  assets 
and  the  roles  of  the  stakeholders  [Adler  90,  Gladwell  02]. 


5.2.2  Establish  Technology  Adoption  Project  Goals  and 
Metrics 

The  second  phase  of  the  technology  adoption  process  is  the  development  of  an  adoption  plan. 
The  focus  of  this  phase  is  to  ensure  that  the  technology  adoption  supports  the  business  objec¬ 
tives  of  the  company,  and  to  ensure  that  the  results  of  the  adoption  are  measurable.  While 
this  focus  is  important  in  any  organization,  large  or  small,  it  is  critical  for  the  SME.  While 
there  are  many  reasons  for  the  technology  adoption  failures  among  SMEs,  failure  to  link 
technology  adoption  to  key  business  objectives  is  one  of  the  more  common  [Buhman  03].  In 
creating  this  linkage,  the  SME  must  understand  current  business  practices,  current  operations 
processes,  the  company’s  strategic  goals,  and  the  company’s  desired  future  state. 

Technology  adoption  is  frequently  both  a  capital  expense  and  a  workforce  development  ef¬ 
fort.  For  SMEs,  both  of  these  are  a  challenge: 

•  Capital  investment  is  difficult  due  to  the  often-limited  financial  resources  of  the  SME. 

•  Workforce  development  is  difficult  due  to  both  the  expense  of  training  and  the  “out-of- 
the-office”  time  of  key  employees. 

For  these  and  other  reasons,  SMEs  are  often  very  conservative  when  investing  in  technology 
adoption,  and  demand  a  “bulletproof’  business  case  before  proceeding. 

The  technology  adoption  process  builds  this  business  case  in  five  steps. 

1.  Begin  Metrics  Collection 

Begin  collection  of  metrics  to  establish  a  baseline  against  which  future  improvements  can  be 
evaluated.  This  activity  may  also  involve  calculating  measures  from  a  previous  time  period 
using  available  data.  This  activity  is  often  the  first  time  that  an  SME  has  obtained  an  in- 
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depth  view  of  the  process  to  be  improved.  This  clear  view  of  an  inefficient  and/or  ineffective 
process  will  often  serve  as  a  stimulus  to  reinforce  the  process  improvement  activity. 

2.  Identify  Improvement  Options 

Identify  multiple  improvement  options  that  meet  the  goals  of  the  improvement  effort.  Many 
ideas  may  come  from  company  employees  at  all  levels  and  some  improvement  options  may 
or  may  not  include  adoption  of  new  technologies.  Ideas  that  involve  a  technology  should  re¬ 
main  general.  (For  example,  an  option  should  be  expressed  as  “Adopt  3-D  CAD”  vs.  arbitrar¬ 
ily  specifying  a  3-D  CAD  tool  vendor.) 

3.  Create  a  Draft  Business  Case 

Evaluate  the  improvement  options  to  determine  both  the  total  cost  (e.g.,  capital  investment, 
training  costs,  sustainment  costs,  licensing)  of  technology  adoption  and  the  expected  return. 
Estimate  and  analyze  cash  flow,  a  subject  critical  to  many  SMEs.  Create  and  distribute  a 
draft  business  case  summarizing  this  information,  along  with  measures,  approach,  and  ration¬ 
ale. 

4.  Create  a  Draft  Technology  Adoption  Plan 

Create  a  draft  technology  adoption  plan.  This  plan  should  include  the  following: 

•  delineation  of  stakeholder  expectations; 

•  adoption  process  schedule  and  milestones; 

•  adoption  process  staffing; 

•  communication  processes;  and 

•  constraints  (e.g.,  time,  money,  staff  availability,  user  skills)  imposed  upon  the  adoption 
process. 

5.  Identify  Adoption  Risks 

Define  detailed  adoption  context  by  identifying  barriers  and  risks  to  adoption,  including  peo¬ 
ple  and  organizational  constraints.  For  example,  identify  Adler  weaknesses  in  terms  of  or¬ 
ganizational  assets  and  appropriateness  of  roles  [Gladwell  02]. 


5.2.3  Evaluate  Technology  Options 

The  third  phase  of  the  technology  adoption  process  is  the  evaluation  and  selection  of  the  ap¬ 
propriate  technology. 

1.  Cost  Benefit  Analysis 

Document  the  costs  and  benefits  of  each  of  the  improvement  options,  including  initial  and 
recurring  costs  as  well  as  both  tangible  and  strategic  benefits.  Prioritize  the  improvement 
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options  based  upon  the  draft  business  case  and  the  draft  technology  adoption  plan.  Select  the 
best  option  based  upon  current  understanding.  Selecting  multiple  improvements  at  one  time 
should  be  avoided  to  avoid  the  chaos  zone  shown  in  Figure  4. 

2.  Identify  and  Use  Selection  Criteria  To  Evaluate  Potential  Tools 

If  the  selected  improvement  option  involves  adoption  of  a  new  technology,  identify  selection 
criteria  and  begin  an  evaluation  process  to  select  a  specific  product  that  supports  the  technol¬ 
ogy.  Due  to  the  often  complex  nature  of  the  selection  process  the  use  of  a  structured  selec¬ 
tion  process  is  recommended.6 

3.  Test  Using  a  Sample  Problem 

Identify  a  model  problem  to  test  high-risk  aspects  of  the  proposed  solution.  This  is  also  im¬ 
portant  to  validate  vendor  claims  and  identify  changes  needed  to  integrate  the  technology  into 
the  future-state  business  process. 

4.  Evaluate  the  Fit  of  the  Technology  to  Organization  Factors 

Consider  the  desired  technology  against  the  capabilities  of  the  organization  and  examine  the 
risks  and  supporting  context.  This  activity  can  point  to  likely  adoption  patterns  and  provide 
insight  into  the  plan  and  schedule  of  the  technology  adoption. 


5.2.4  Obtain  Technology 

The  fourth  phase  of  the  adoption  process  is  the  actual  procurement  of  the  technology  and  es¬ 
tablishment  of  use  goals,  final  adoption  plan,  and  n  transition  communication  mechanisms. 

1.  Procure  Technology 

Finalize  agreements  with  the  technology  vendor  to  purchase  the  selected  product  and  any 
necessary  training  and/or  consulting  support. 

2.  Establish  Level  of  Use  Goals 

Define  level  of  use  goals  for  the  technology.  Define  these  goals  not  just  as  the  magnitude  of 
technology  use,  but  in  terms  of  roles  and  process  steps.  For  example,  set  objectives  for  when 
a  3D  CAD  tool  is  used  within  a  development  process  (like  the  proposal  step)  and  which  roles 
(e.g.,  engineer,  designer)  use  the  tool. 

3.  Finalize  Technology  Adoption  Plan 

Update  and  finalize  the  draft  technology  adoption  plan  to  include  all  activities  required  to 
move  from  the  “as-is”  to  the  “to-be”  business  processes. 


6  Anderson,  Selecting  (see  Section  4,  note  4). 
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4.  Build/Deploy  Transition  Mechanisms  for  Communication 

Create  the  necessary  communication  items  (e.g.,  progress  reports,  training  plans)  and  distrib¬ 
ute  to  the  stakeholders. 


5.2.5  Implement  and  Adopt  Technology 

1.  Install  the  Technology 

Insert  the  technology/tool  into  the  company  business  using  the  “to-be”  business  process. 

2.  Build/Deploy  Transition  Mechanisms  for  Implementation 

Provide  all  transition  items  for  implementing  the  To-Be  process  as  described  in  the  technol¬ 
ogy  adoption  plan,  including  training,  consulting,  and  transition  monitoring  and  metrics  col¬ 
lection. 

3.  Manage  Adoption  Issues  and  Risks 

Actively  and  regularly  monitor  the  adoption  risks  and  context  because  the  context  is  always 
changing.  This  includes  observing  progress  against  metrics  and  observing  indicators  of  tech¬ 
nology  adoption  bottlenecks. 

5.2.6  Analyze  and  Deliver  Adoption  Results 

This  final  phase  of  the  technology  adoption  process  is  focused  upon  institutionalizing  the 
adoption  process  within  the  SME.  Part  of  this  process  involves  building  support  for  the  fu¬ 
ture  technology  adoption  efforts  by  publicizing  the  success  of  past  and  current  efforts. 

1.  Document  the  Business  Impact 

Summarize  the  business  impact  in  terms  of  tangible  and  strategic  benefits.  This  also  includes 
asking  employees  about  impact  throughout  the  implementation. 

2.  Collect  Technology  Adoption  Lessons  Learned 

Examine  how  the  organization  (including  people,  assets,  and  context)  performed  in  the  tech¬ 
nology  adoption  and  identify  ways  to  improve  in  technology  adoption.  For  example,  did  the 
organization  meet  the  technology  level  of  use  objectives  as  well  as  the  business  objectives? 

3.  Roll  Out  to  Relevant  Stakeholders 

Summarize  the  business  case  and  communicate  it  to  the  company  stakeholders,  both  internal 
and  external. 
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6  Conclusion 


The  intent  of  Volume  I  [Fenves  03]  and  Volume  II  of  this  report  series  has  been  to  build 
awareness  of  the  AEE  concept,  and  to  provide  guidance  to  SMEs  considering  the  adoption  of 
AEE  technology.  This  chapter  summarizes  key  concepts  presented  in  these  two  volumes. 

AEEs  are  integrated  toolsets  that  enhance  the  productivity  of  participants  in  the  product 
development  and  production  processes.  They  are  defined  as  computational  and 
communications  systems  that  can  create  virtual  and/or  distributed  environments  functioning 
to  link  researchers,  technologists,  designers,  manufacturers,  suppliers,  and  customers. 

AEEs  may  be  classified  in  three  levels.  A  Basic  AEE,  well  within  the  reach  of  most  SMEs, 
consists  of  only  two  well-matched  COTS  software  products  providing  design  and  analysis 
capabilities.  An  Intermediate  AEE  is  also  suitable  for  implementation  by  SMEs.  While 
also  composed  of  COTS  design  and  analysis  products,  it  provides  higher  levels  of  data 
integration  and  interoperability  than  the  Basic  AEE.  A  Comprehensive  AEE  providing  total 
data  sharing  and  interoperability  with  both  technical  and  non-technical  IT  systems  throughout 
the  organization  does  not  yet  exist.  This  description  serves  primarily  as  a  roadmap  of  future 
developments  and  standardization  efforts  at  the  component  interfaces. 

An  AEE  enables  an  SME  to  utilize  more  efficient  and  more  effective  design  processes. 
Without  the  benefits  of  an  AEE,  an  SME  is  forced  to  design  a  product  based  upon  experience 
and  limited  manual  analysis  processes.  True  functionality  of  the  product  is  not  known  until  it 
is  built  and  tested.  With  an  AEE,  the  SME  may  analyze  and  predict  end-product  performance 
while  still  in  the  design  stage,  enabling  optimization  of  the  design.  As  the  SME  migrates  to 
more  advanced  AEEs,  this  prediction  and  optimization  process  becomes  faster,  easier,  and 
more  effective.  Some  of  the  benefits  an  AEE  can  offer  to  an  SME  include  the  following: 

•  Reductions  in  product  development  time  -  AEEs  encourage  and  support  design  reuse 
and  parametric  design  processes,  eliminate  redundant  efforts  during  the  design  process, 
encourage  functional  analysis  earlier  in  the  design  cycle,  and  encourage  collaboration 
among  designers,  engineers,  manufacturers,  suppliers,  and  customers. 

•  Reductions  in  production  time  -  AEEs  enable  design  optimization  by  eliminating 
overly  conservative  assumptions.  They  minimize  component  inventories  by  encouraging 
and  supporting  design  reuse.  They  also  enable  process  designers  to  simulate  and  opti¬ 
mize  manufacturing  processes  during  the  product  design  stage. 
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•  Improvements  in  product  quality  -  AEEs  encourage  and  support  functional  analysis 
and  simulation  prior  to  manufacturing.  They  enable  design  optimization  by  evaluating 
the  impacts  of  design  tradeoffs.  They  validate  design  performance  prior  to  manufactur¬ 
ing.  They  encourage  and  support  multi-disciplinary  collaboration  among  designers,  en¬ 
gineers,  manufacturers,  suppliers,  and  customers.  They  encourage  and  support  reuse  of 
existing  successful  designs.  They  enable  the  use  of  advanced  simulation  techniques  such 
as  Monte  Carlo  and  Taguchi  methods  [Taguchi  00]. 

•  Reductions  of  product  cost  -  AEEs  enable  design  optimization,  eliminating  costly, 
overly  conservative  assumptions.  They  encourage  and  support  design  reuse,  minimizing 
the  required  component  inventory.  They  enable  process  designers  to  simulate  and  opti¬ 
mize  manufacturing  processes  during  the  product  design  stage.  They  can  also  reduce 
maintenance  costs,  spare  parts  inventories,  warranty  costs,  field  changes,  and  upgrades. 
That  is,  doing  it  right  up  front  has  enormous  impact  on  the  cost  of  the  product  over  its  life 
cycle,  to  both  the  producer  and  the  customer. 

•  Reductions  of  product  development  cost  -  AEEs  create  reductions  in  the  product  de¬ 
velopment  schedule  (see  above).  They  detect  functional  problems  earlier  in  the  design 
process,  when  they  are  less  costly  to  fix.  They  encourage  and  support  design  experi¬ 
ments  early  in  the  design  process. 

•  Improved  market  agility  -  AEEs  enable  the  SME  to  cope  with  rapidly  changing  global 
market  demands  and  competitive  environments. 

•  Improved  communications  -  AEEs  provide  a  means  of  improving  communications  with 
both  customers  and  suppliers,  strengthening  the  supply  chain. 

The  process  of  adopting  an  AEE  begins  with  the  evaluation  of  the  current  state  of  the  SME. 
The  SME  must  determine  the  current  mix  of  products,  degree  of  internal  integration,  current 
level  of  computer  use,  current  skill  and  knowledge  levels,  and  perceived  problems.  This  is 
followed  by  the  definition  of  a  goal  state,  including  the  desired  future  state  of  the  SME,  and 
the  strategies  to  overcome  the  perceived  problems.  From  this  information,  the  SME  may  de¬ 
termine  the  scope  and  level  of  the  AEE  to  be  adopted,  leading  to  the  specification  of  the  re¬ 
quirements  for  the  components  of  the  AEE,  and  the  selection  of  the  COTS  AEE  components 
satisfying  these  requirements. 


The  components  described  in  this  report  cover  a  wide  range  of  characteristics  necessary  to 
implement  AEEs.  A  single  SME  does  not  need  to  implement  all  of  these  components,  but 
needs  to  carefully  identify  the  components  necessary  for  its  specific  needs,  the  planned  inter¬ 
actions  between  them,  and  the  range  of  COTS  products  implementing  the  needed  compo¬ 
nents.  A  carefully  prepared  plan  will  lead  to  successful  expansion  of  the  AEE  with  additional 
components  in  the  future.  These  reports  provide  a  tool  to  assist  the  SME  in  defining  the 
value  of  an  AEE  to  its  operation,  and  a  tool  to  assist  the  SME  in  identifying  the  AEE  content. 


Many  SMEs  evolve  or  migrate  from  lower  AEE  levels  to  higher  ones.  As  new  tools  and  ca¬ 
pabilities  are  introduced  into  a  company’s  support  environment  on  an  incremental  and  oppor¬ 
tunistic  basis,  the  SME  must  recognize  the  shifts  in  operational  modes  and  philosophies  will 
be  needed  to  gain  the  full  benefit  of  the  AEE. 
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In  choosing  a  tool  to  be  added  to  the  SME’s  engineering  environments,  the  SME  must  con¬ 
sider  the  functional  capabilities  of  the  tool,  based  on  current  and  expected  future  needs;  how¬ 
ever,  the  SME  must  also  take  into  account  potential  changes  in  business  and  software.  The 
SME  must  also  ensure  that  the  tool’s  interoperability  is  appropriate  to  support  the  organiza¬ 
tion’s  overall  product  development  process.  Usability,  particularly  the  extent  to  which  the 
tool  is  deemed  “intuitive”  and  reasonably  “transparent”  by  its  potential  users,  is  a  key  factor 
in  tool  selection.  Expandability,  in  terms  of  tool  features  that  may  be  subsequently  added  and 
customization  that  users  may  apply  to  extend  the  tool’s  capabilities,  should  also  be  consid¬ 
ered. 

Selection,  procurement,  and  installation  of  a  new  technology  will  not  produce  the  desired 
benefits  until  the  SME  adopts  the  technology  and  integrates  it  into  its  operation.  Only  when 
the  SME’s  staff  is  aware  of  the  technology,  has  access  to  it,  is  trained  to  use  it,  gets  support 
for  using  it,  and  actually  DOES  use  it  will  the  benefits  accrue  to  the  SME. 

A  six-step  technology  adoption  process  based  upon  the  Shewart  Cycle  is  described.  The 
process  has  been  used  successfully  to  introduce  advanced  technologies  into  SMEs  and  con¬ 
sists  of  the  following  steps: 

1 .  Understand  existing  company  environment; 

2.  Establish  technology  adoption  project  goals  and  metrics; 

3.  Evaluate  technology  options; 

4.  Obtain  technology; 

5.  Implement  and  adopt  technology; 

6.  Analyze  and  deliver  adoption  results. 
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Acronyms 


2D 

Two-Dimensional 

3D 

Three-Dimensional 

AEE 

Advanced  Engineering  Environment 

ASP 

Application  Service  Provider 

CAD 

Computer-Aided  Design 

CAE 

Computer-Aided  Engineering 

CAM 

Computer-Aided  Manufacturing 

CMU 

Carnegie  Mellon  University 

COTS 

Commercial  Off-the-Shelf 

FEA 

Finite  Element  Analysis 

IDEAL 

Initiate,  Diagnose,  Establish,  Act,  and  Leverage 

IGES 

Initial  Graphics  Exchange  Specification 

NC 

Numerical  Control 

NIST 

National  Institute  of  Standards  and  Technology 

PDM 

Product  Data  Management 

RFQ 

Request  for  Quotation 

SEI 

Software  Engineering  Institute 

SME 

Small  Manufacturing  Enterprise 

STEP 

Standard  for  the  Exchange  of  Product  Model  Data 

TIDE 

Technology  Insertion,  Demonstration,  and  Evaluation 
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